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Abstract. We study positive random variables whose moments can be 
expressed by products and quotients of Gamma functions; this includes 
many standard distributions. General results are given on existence, 
series expansion and asymptotics of density functions. It is shown that 
the integral of the supremum process of Brownian motion has moments 
of this type, as well as a related random variable occuring in the study 
of hashing with linear displacement, and the general results are applied 
to these variables. 



1. Introduction 

We say that a positive random variable X has moments of Gamma type 
if, for s in some interval, 

EX' = CD' ^^^-^ ^ — (1.1) 



nti + b[ 



k) 



for some integers J,K >{) and some real constants C, > 0, aj, a'^, 6'^. 
We may and will assume that aj ^ and a'^ / for all j and k. We often 
denote the right hand side of (jl.ip by F{s); this is a meromorphic function 
defined for all complex s (except at its poles). 

Similarly we say that a real random variable Y has moment generating 
function of Gamma type if, for s in some interval. 



n/=ir(a,^ + 6, 



for some integers J, > and some real constants C, d, aj / 0, bj, a'^ ^ 0, 
b'l^, and that Y has characteristic function of Gamma type if, for all real t, 

E e^*^ = Ce'^'^^^p^—^ — (1.3) 

for some such constants. 

Of course, (jl.ip and (jl.2p are the same if X = and D = e'^; further, it 
will be shown that (jl.2p and (jl.3p are equivalent by analytic continuation. 
Moreover, we shall see that the range of validity of (jl.ip . or (|1.2p is always 



Date: 22 February, 2010. 

2000 Mathematics Subject Classification. 60E10; 60J65. 

1 



2 



SVANTE JANSON 



the largest possible. We summarize these simple but useful observations in 
Theorem 12.11 below. 

Remark 1.1. The representations in ()l.ip - ()1.3p are far from unique. Using 
the duplication formula ()A.3p . or more generally the multiplication formula 
()A.5p . and other relations such as the functional equation T{z + 1) = zT{z), 
a function F{s) of this form may be rewritten in many different ways. (More 
or less transparently; some equivalent versions may look quite different to 
the unaided eye.) See for example Theorems 11.61 and 11.121 

Remark 1.2. The constant C is determined by the relation -F(O) = KX^ = 
1, which shows that 

C = nf=i ^(^fc) (1.4) 

n/=ir(6,) 

provided no bj or 6^ is a non-positive integer. In general, C can be found 
by taking limits as s — )• 0. 

Remark 1.3. The constant D is just a scale factor: X satisfies (jl.ip if and 
only if X/D satisfies the same equation with D replaced by 1 (i.e., without 
the factor D^). Similarly, Y satisfies (jl.2p or (jl.3p if and only if Y — d 
satisfies the same equation with d replaced by 0. Hence we might assume 
L) = 1 or d = if convenient (but we will not do so in general). 

Remark 1.4. If r E i?, then x — r = T(x — r + l)/r(x — r). Hence, any 
rational function Q{x) with all poles and zeros real can be written as a finite 
product Yle r(x + Ci)/T{x + c^) with C£, G M. Consequently we may allow 
such a rational factor Q{s) in (jl.ip and ()1.2p . or Q{it) in (jl.Sp . without 
changing the class of distributions. 

Remark 1.5. If X has moments of Gamma type and a is a real num- 
ber, then X°' has moments of Gamma type. (Just substitute as for s in 
(jl.ip .) Similarly, if Xi and X2 are independent and both have moments of 
of Gamma type, then X1X2 has too. (Just use E(XiX2)' = EXf EX|.) 

Several well-known distributions have moments or moment generating 
functions of Gamma type. We give a number of examples in Section [31 

The main motivation for the present paper is that also several less well- 
known distributions have moments of Gamma type. It is then straightfor- 
ward to use Mellin transform techniques to obtain expansions or asymptotics 
of the density function, and it seems advantageous to do so, and to study 
other properties, in general for this class of distributions. 

In particular, this paper was inspired by the realization that some recently 
studied random variables have moments of Gamma type. One is the integral 
of the supremum process of a Brownian motion, i.e., the area under the 
supremum process (up to some fixed time T). Let B{t), t > 0, be a standard 
Brownian motion. Consider the supremum process S{t) := maxo<s<j -B(i), 
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and its integral 

A{T) := / Sit)dt. (1.5) 
Jo 

We further let A := ^(1). For any given T > 0, the usual Brownian 
scaling {B{Tt)}t>o = {T^^^ B{t)}t>o implies the corresponding scaling for 
the supremum process {S{Tt)}t>o = {T'/^S{t)}t>o, and thus 

A{T) =T r S{Tt) dt = T^/^A. (1.6) 
Jo 

In particular, E^(r)'' = T^'^/^E^'' and it is enough to study A. 

The random area A was studied by Janson and Petersson [l^ , and using 
their results we will in Section [7] prove the following formula, showing that 
A has moments of Gamma type. (The result for the integer moments KA^, 
n G N, was given in [3].) We give several different, but equivalent, formulas 
of the type (jl.ip for E^*, which exemplifies Remark 1 1.1 1 The third version, 
with only two non-constant Gamma factors is perhaps the simplest. The 
last, where all Gamma factors are of the type T{s/2 + b) with < 6 < 1 is 
of a canonical type where there are no cancellations of poles, and it is thus 
easy to see the poles and zeros, cf. Remark 14.51 



Theorem 1.6. The moments of A are given by, for Res > —1, 

^ Tis + l)T{s + 2/3) 

r(2/3)r(3s/2 + l) vVs^ 
_ r(s + l)r(s + 5/3) /J_y 
~ r(5/3)r(3s/2 + 2) ■ 1^8^ 
_ 2r(l/3) r(3s/2 + 3/2) /^/8^ 
~ 3V^ r(s + 4/3) ' V~9~ 

r(l/3) r(s/2 + l/2)r(s/2 + 5/6) /2y/2 



2i/3vr r(s/2 + 2/3) V3 

Further, MA'^ = oo for real s < — 1. 



Remark 1.7. Several related Brownian areas are studied in Janson jl7[|, 
for example the integral of |-B(i)| or the integral of a normalized Brownian 
excursion. These areas do not have moments of Gamma type. In fact, most 
of the Brownian areas studied there have entire functions EX* [itI . §29], 



which is impossible for moments of Gamma type, see Theorem |4J (iv) (For 



the remaining two areas in 17[ , we have no formal proof that they do not 
have moments of Gamma type, but it seems very unlikely since the integer 
moments satisfy more complicated recursion formulas [17|.) 

As a consequence of Theorem 11.61 and our general results in Section [6l we 
can express the density function of A using the confluent hyper geometric 
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function (denoted M in [1] and ^> in [20|]) or the confluent hypergeo- 
metric function of the second kind U [l| (also denoted ^ [13] )• (Also the 
proofs of the next two theorems are given in Section [71) 

Theorem 1.8. A has a density function fj\,{x) given by, for x > 0, 



2^/^r(l/3) ^ r(n + 5/6) /3^"+i/2 

JA[^)- 31/2^ nlT(n + 2/3)'\2 

n=0 



22/3r(l/3) ^ r(n + 7/6) /3x«+5/6 2^+2/3 



S^/^TT ' n!r(n + 4/3) V2 

2I/2 ^ /5 2 3 2A 2-1/63I/3 2/3 ^ 4 3 



^1/2 ^ ^\^6' 3' 2 y r(5/6) V6' 3' 2 



-X 



3 ^2 



2I/2 / 1 2 3 2A 2-1/63I/3 ^ / I 4 3 

1^1 -7t; 77; 773; + x^/^ li^i 



r(2/3) V 6' 3' 2 



r(2/3) V6'3'2' 

It follows (most easily from the second formula above) that has a 
finite, positive limit /y4(0+) = y2pK as x \ 0. More precisely, fji,{x) = 

727^ +0(^2/3). 

As X — )• 00, we obtain from Theorem 11.61 and our general theorems in 
Section [6] the following asymptotic result. Note that the two terms in the 
first or second formula for /_4 in Theorem 11.61 are each much larger, of the 
order x~^/^ by the asymptotics of iFi in [1, (13.5.1)], but they cancel each 
other almost completely for large x. 

Theorem 1.9. 

32/3r(l/3) 1/3 _3^2/2 2-31/6 1/3 _3^.2/2 

fA{x) x^'^e I' = e x ^ 00. 

This result was conjectured in [191], where the weaker result P(^ > x) = 
exp{-3xV2 + o(x2)} was shown from the moment asymptotic 

for integer s and a Tauberian theorem. (Only integer moments were con- 
sidered in fiof]. Note that (|1.7p for arbitrary real s — )• 00 follows easily from 
Theorem 11.61 and Stirling's formula; see Theorem 15.71 and (17. 8p .) 

Remark 1.10. Theorem 11.91 also follows from any of the last two formulas 
in Theorem 11.81 and the asymptotic formula for U in [H, (13.5.2)]. Indeed, 
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this gives an asymptotic expansion with further terms, cf. Remark I6.3t in 
this case, by [H, (13.5.2)], the complete asymptotic expansion can be written 



•'•^^ ^ r(2/3) v6 6" 3 y ' 



00, 



where the hypergeometric series 2-^0 is divergent and the asymptotic expan- 
sion is interpreted in the usual way: if we truncate the series after any fixed 
number of terms, the error is of the order of the first omitted term. (For 
the general definition of the (generalized) hypergeometric series p-Fg, see e.g. 
[13I . Section 5.5].) 

Theorem II. 91 may be compared with similar results for several other Brow- 
nian areas in Janson and Louchard [3], see also Janson [l7] and Remark 1 1.71 
In these results for other Brownian areas, the exponent of x is always an 
integer (0, 1 or 2), while here the exponent is 1/3, which is related to the 
power s^l'° in (II. 7j) . 

Another example with moments of Gamma type comes from Petersson 



241 ]. He studied the maximum displacement in hashing with linear probing. 



and found for dense tables, after suitable normalization, convergence to a 
limit distribution given by a random variable M. with the distribution (23 . 
Theorem 5.1] 

P(A^ < x) = 1 - V'(3;3/2)^ ^^Q^ (j g) 

where V'(s) := Ee~*'^ is the Laplace transform of A. Equivalently, 

P(7W >x) = V'(x3/2) ^ g e-^'/M^ ^ > Q_ (1^9) 

This type of relation preserves moments of Gamma type; we give a general 
result. 

Lemma 1.11. Suppose that V and Z are two positive random variables and 
a > 0. Then 

P(1/ > x) =Ee-^"^, 3;>0, (1.10) 

if and only if 

V = ri/"/zV", (1.11) 

where T E Exp(l) is independent of Z. 
If (fTTO]) or IfTTT]) holds, then 

EV = r{s/a + l)EZ-'/'', s>-a. (1.12) 

In particular, if one of Z and V has moments of Gamma type, then so has 
the other. 

We postpone the simple proof until Section [8l By (11. 9p . Lemma 11.111 
applies to Ai and A, and thus Ai has moments of Gamma type. More 
precisely. Theorem 11.61 implies the following, see Section [8] for details. 
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Theorem 1.12. For -3/2 < Res < 3/2, 

F - + 2^3) r(2/3 - 2s /3) Tjl - 2s/3) 

r(2/3)r(i-s) '132/3; 

_ 2r(l/3) r(l + 2s/3)r(3/2 -s) /3^/3., 
~ 3y/7r r(4/3 - 2s/3) V~/ 

r(l/3) r(l + 2s/3)r(l/2-s/3)r(5/6-s/3) /3y/3 



2V3vr r(2/3-s/3) V2 

r(l/3) r(l/2 + s/3) r(l + s/3) r(l/2 - s/3) r(5/6 - s/3) g,/3 



2V3vr3/2 r(2/3 - s/3) 

Further, EA^* = oo for real s < —3/2 or s > 3/2. 



The special case s = 1 yields EA^ = 2r(l/3)/32/3, as found by Petersson 



24l |. Petersson [2j] further proved that EA^'^ = oo for s > 2; we now see 



^3n/2+l/2 



that the sharp threshold is s = 3/2. 

Our general theorems apply again; they show that Ai has a density, and 
they yield a series expansion and asymptotics for the density. (Proofs are 
given in Section [51) Again, the results can be exp ressed using various hy- 
pergeometric functions and series. (Again, see [13[] for definitions.) 

Theorem 1.13. Ai has a continuous density function given by, for x > 0, 
, , _ 3V2r(i/3) ^^„ r(l + n/2)r(4/3 + n/2) ^2^n/2 

fM[x)- 25/6^ I) r(7/6 + n/2)n! 

n=0 

- ^ 1/2 Z7 ^1 1 I 1 _ - 2 Z7 ^li ^ ^ 

-^1/2^ '^Hs' '6'2' 6/ S"" ' ^6'3' 6 
In particular, for small x we have the asymptotic formula 

fMix) = ^x^^^ + Oix^), x\0. (1.13) 

For large x, there is a similar formula, which is the beginning of a divergent 
asymptotic expansion (interpreted as in Remark II. 10|) : 

Theorem 1.14. As x ^ oo, 

fM{x) = -^x-'/^ + 0(x-^/2). (1.14) 



More precisely, fjviix) has as x ^ oo an asymptotic expansion 
„ / N 3 <;/9^/35 2 6 
^^(^)~71^^ '^^^(2'6'^'3^-^^ 

I 5r(l/3) ^r^l 7.. 6x 

+ 21/232/3^1/2^ ^^°U'6""^^J- ^^-^^^ 

Yet another recent example of moments of Gamma type comes from the 
study of generalized Polya urns 16 1; see Section [H 
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We give some basic reults in Section O and further results on poles and 
zeros in Section [H Many examples with standard distributions are given in 
Section [31 Asymptotics of the moments are studied in Section [5l and asymp- 
totics and series expansions of the density function are given in Section [6l 
As said above, we give proofs of the results above for A and M. in Sections 
[3 and El and we give some results for generalized Polya urns in Section [H 
We end with a couple of more technical examples (counter examples) in 
Section [TOl and some further remarks in Section [TTl Some standard formulas 
for the Gamma function are for convenience collected in Appendix lAl 

2. The basic theorem and some notation 

Let F{s) denote the right hand side of (11. ip or (II. 2p . (Thus, the right 
hand side of ()1.3p is F{[t).) Evidently, F is a meromorphic function in the 
complex plane, and all poles are on the real axis. Let and />_ be the 
poles closest to 0: 

«+ := minjx > : x is a pole of F), 

(2.1) 

p_ := max{x < : x is a pole of F}, 

with the interpretation that = oo [p_ = — oo] if there is no pole on (0, oo) 
[(— oo, 0)]. Thus — oo < p_ < < p+ < oo. Note that we ignore any pole at 
in the definitions (12. 1^ : however, it follows from Theorem 12.11 that such a 
pole cannot exist; F{s) is always analytic at s = 0. 

Theorem 2.1. Let X > and Y be random variables connected by X = e^ 
and thus Y = logX, and let C , D > 0, d = logD, Uj / 0, bj, a'^, / 0, 
b'^ be real constants, for j = 1, . . . , J > and k = 1, . . . , K > 0. Let F{s) 
be the meromorphic function in (jl.ip and (jl.2p and let pj^ € (0, oo) and 
P- G (—00,0) be defined by (|2.ip . Then the following are equivalent: 

(i) (|l.ip holds for all real s in some non-empty interval. 

(ii) (|l.ll) holds for all complex s in the strip p„ < Re s < pj^. 

(iii) (|1.2I) holds for all real s in some non-empty interval. 

(iv) ()1.2I) holds for all complex s in the strip p_ < Re s < p-|_ . 

(v) (jl.3p holds for all real t ^ in some interval \t\ < to with to > 0. 

(vi) (jl.3p holds for all real t. 

In this case, further KX^ = Ke^^ = oo if s < p^ or s > pj^; thus 
{s € R : EX" < oo} = {.s G R : Ee"'^ < oo} = (p-,p+). 
Equivalently, 

p+ = sup{s > : EX' < oo}, 
p_ = inf{s < : EX' < oo}. 

Furthermore, F{s) = EX' = Ee'-^ 7^ when p_ < Res < p+. 



SVANTE JANSON 



(i) 




< — 


y 


(iv) 



(iii) and|(ii) 



111, 



(v)| and |(iv^ 



Proof. 
trivially 

equivalences it suffices to show that 

Note first that ip{t) 



(iv)| are trivial, since EX* = Ee'*^. Further, 

Hence, to show the 



(iv; 



m 



(vi) 



=^ (v) and (v 
E^ 



;iv) 



1 as t 



0. Hence, 



F{it) — )■ 1 as t \ 0, and thus F does not have a pole at 0. 

This shows that F{z) is analytic in the strip < Rez < p+, and thus 
F{iz) is analytic in the strip — /0+ < Imz < —p-. By continuity, (^(t) = F(it) 
also for t = and thus for the entire interval {—to, to). Hence, on this 
interval at least, <p{t) equals the boundary values of the function F{it) which 
is analytic for < Imz < — p_ and by a theorem of Marcinkiewicz [23 |. 
Ee"''^ < oo for every r G (0, —p~)', equivalently, Ee''^ < cxd if p_ < r < 0. 
By considering —Y, we find similarly that Ke^^ < oo if < r < p+. 
Consequently, 

Ee'''*^<oo ifp_<r<p+. (2.2) 

It is well-known that ()2.2p implies that il^{z) := E e^^ is defined and finite for 
P- < Re 2 < and that tl^{z) is an analytic function of z in this strip. Since 
■0(it) = ^{t) = F{it) for |t| < to, analytic continuation yields ip{z) = F{z) 
in this strip, i.e. (iv) holds. 

(iii) =^ (v) Suppose that Ke^^ = F{s) for s G (a, 6), with — oo < a < 
b < oo. Let So G {a,b) with so / and suppose that so > 0. (The case 
So < is similar, or follows by considering —Y.) Thus Ee''"-*^ = F{so) < oo, 
and it follows that z i— )• E e^^ is defined and analytic for < Re z < so. Since 
Ee^^ = F{z) on an interval in this strip, Ee^^ = F{z) for < Rez < so. 

For any real t, we may take z = it + e for < e < so; letting e \ we 
have Ee^'*"'"^-'^ — )• Ee^*-*^ by dominated convergence (using E(l-|-e''°^) < oo). 



F{it + £)—;■ F{it) since F has only 



If further t / 0, then also Ee('*+=)^ 
real poles, and thus Ee'*^ = F{it). Hence (v) holds. 

This completes the proof of the equivalences. Suppose Ke^^ < oo for 
some s > p+ (and thus p+ < oo). Letting z we then have, by 

dominated convergence, F{z) = Ee^^ — t- Ee''+-*^ < oo, while the definition 
of p+ as a pole yields F{z) = \F{z)\ — )• oo. This contradiction shows that 
Ee*^ = oo for s > p^. Similarly, or by considering —Y, Ee''^ = oo for 
s < p_. 

Finally observe that F{s) = only when some a'^s + 6'^ is a pole of F, i.e., 
a non-positive integer, which implies that s is real. However, if p_ < s < p^, 
then F(s) = Ee*'^ > 0. □ 



Remark 2.2. The equivalence (iii 



iv) (or, equivalently, (i 



(ii)) 



is an instance of the well-known fact that a (two-sided) Laplace transform of 
a positive function or measure has singularities where the real axis intersects 
the boundary of the natural strip of definition, see e.g. fi, §3.4]. The result 
by Marcinkiewicz [23] used above is a sharper version of this. 



We make some simple but useful observations. 
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Corollary 2.3. The distribution of X is determined by the function F{s) 
on the right hand side of ([H]); // EXf = F{s) for s £ h andEX^ = F{s) 

for s £ I2, for non-empty intervals Ii and I2, then Xi = X2. 

Proof. By Theorem 12.11 Yi := logXi and Y2 := logX2 have the same char- 
acteristic function F{it). Hence, Yi = Y2 and Xi = X2- □ 



Remark 2.4. As said above, Theorem 12.11 (e.g.. by (vi) ) imphes that is 
not a pole of F; furthermore, F{0) = KX^ = 1. 

Remark 2.5. Every pole or zero of F{s) must be a pole of one of the T 
factors in (11. ip . However, the converse does not hold, since poles in the T 
factors may cancel; if sq is a pole of some factors in the numerator, but also 
a pole of at least as many factors in the denominator, then sq is a removable 
singularity of F, and F{sq) is well-defined by continuity. Note that such sq 
do not count in the definition (12. ip of p±. 

In particular, s = may be a pole of some of the Gamma factors in F{s). 
(This happens when some bj or 6^ is or a negative integer. This is the 
reason we exclude t = in Theorem I2.]](v)[ ) However, by Remark 12.41 all 
such poles must cancel; i.e., there must be an equal number of such factors 
in the numerator and denominator in (jl.ip . 

Remark 2.6. In Theorem I2.1](v)| it is important that we consider an in- 



terval about (unlike in (i) and (iii)). In fact, for any e > 0, there exist 



a random variable Y and C,d,aj,bj,a'f^,b'j^ such that ()1.3p holds for |t| > e 
but not for all e. 

For an example, let Y be any random variable with characteristic function 
of Gamma type, say Ee'*^ = F{it). Further, let Z he a random variable 
with characteristic function (1 — see ^ Section XV.2], and let W be the 
mixture of Z and the constant obtained as W := VZ with V G Be(l/2), i.e. 
¥{V = 0) = V(V = 1) = 1/2, and V independent of Z; assume further that 
Y is independent of Z and V. Then, for \t\ > 1, the characteristic functions 
Ee'*^ = and Ee**^ = i(Ee'*^ + 1) = i and thus Y := Y + £-'^W has the 
characteristic function 

E e**^ = E e'*"^ E e'^''*^ = iF(it), when |t| > e. (2.3) 

Here F{it) := ^F{it) is another function of the type in (jl.Sp : however (j2.3p 

does not hold for all t since F{0) = 1/2 7^ 1. 

We do not know whether (|1.3p for some interval, together with F{0) = 1, 
implies that (|1.3p holds for all t. 

For future use, in particular for the asymptotic results in Sections [5] and [6l 
we define the following parameters, given a random variable X or y or a 
function F{s) as in ([Ll]) or ^L^ : 

7:=El«.|-i;i4l, (2.4) 

j=i k=i 
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J K 



(2.5) 



j=i k=i 



J K 



J-K 



2 



(2.6) 



j=i k=i 




(2.7) 



(2.8) 



Proposition 2.7. The parameters 7,7',^, x, Ci depend on F only and not 
on the particular representation in (II. ip or ()1.2p . 

The proof is given in Section [5l 

Remark 2.8. To replace X by or equivalently Y by — y, means that 
F{s) is replaced by F{—s), which has the same form but with d replaced by 
—d {D by D~^) and similarly the sign of each aj and 4 changed. This 
does not affect 7, 5, and Ci, but 7' and x change signs. (This also follows 
from ([52]) and ([53]) below.) 

Remark 2.9. More generally, X", with a real and non-zero, has parameters 
|a|7, 07', (5, ax + 7'a log |a|, Cilal*^. 

Remark 2.10. li X = X1X2 with Xi,X2 independent and both having 
moments of Gamma type, cf. Remark 11.51 then the parameters 7, j' ,5,>c for 
X are the sums of the corresponding parameters for Xi and X2, while Ci is 
the corresponding product. 

Remark 2.11. If X has moments of Gamma type, then so has a suitably 
conjugated (a.k.a. tilted) distribution: If, for simplicity, X has a density 
function /(x), a; > 0, let X have the density function x'^f{x)/KX'^ for a 
real r such that EX'' < 00. Then EX" = EX'+^'/EX'' and thus X has 
moments of Gamma type, obtained by a simple substitution in ()l.ip . It 
follows that 7, 7' and x are the same for X as for X, while 6 is increased 
by r^' and Ci is multiplied by e^^/EX''. (Cf. (j5.3p below.) Clearly, and 
/9_ are both decreased by r. 

For a random variable Y with moment generating function of Gamma 
type, the same applies to Y with density function e^^/(y)/Ee''^, if Y has 
density function /. 

We note also the following relations, for a function F(s) as above: 

Lemma 2.12. We have 



E 



E "'fc 



^(7+7') 



j:aj>0 



k:a'^>Q 
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j.aj<0 k:a'^<0 



Proof. 



7 + 7 = J2^\aj\ + aj) - ^(141 + 4) = 2( ^ aj - ^ a[ 



j k j-a.j>0 k:a'^,>0 

j fc j:aj<0 fc:a[,<0 

3. Some examples 

There are several well-known examples of distributions with moments of 
Gamma type. We collect some of them here. The results below are all 
well-known. We usually omit scale parameters that may be added to the 
definitions of the distributions. 

Example 3.1 (Gamma distribution). Let Fq, have the Gamma distribu- 
tion r(Q) = r(a, 1) with density function f{x) = x°'~^ /T (a) , x > 0, for 
a parameter a > 0. Then, for Res > —a, 

ET^ = / x'f{x)dx = -— / x^+-'e-^dx = ^ / \ (3.1) 
Jo r(a) Jo T{a) 

a simple example of moments of Gamma type. The right hand side of (j3.ip 
is an analytic function in Res > —a, with a pole at —a; thus = 00, 
P- = —a, and EF^ = 00 when s < —a. 

We have 7 = 7' = 1, 5 = a - 1/2, x = 0, Ci = V2^/T{a). 

Note that the different Gamma distributions can be obtained by conju- 
gation from each other, cf. Remark 12.111 

Example 3.2 (Exponential distribution). The exponential distribution 
Exp(l) with density function e~^, x > 0, is the special case a = 1 of the 
Gamma distribution in Example 13. 11 We thus obtain from (j3.ip (or directly 
from (lATll ). for T G Exp(l), 

ET'' = r(s + l), Res>-1, (3.2) 

while ET* = 00 when s < —1. 

More generally, if has an exponential distribution Exp(/u) = T(l,p) 
with mean p, which has the density function is p~^e~^^^, x > 0, then 

= pT and 

ET^ = r{s + l)p', Res>-1. (3.3) 

Thus has moments of Gamma type, with /3+ = oo, p_ = — 1,7 = 7' = !, 
S = 1/2, x = log^, Ci = V2^. 
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Example 3.3 (Uniform distribution). Let U have a uniform distribution 
U(0, 1) on [0, 1]. Then, obviously, for Res > —1, 

1 

EU" = / x'dx = . (3.4) 

Jo s + l 

This can be rewritten as a Gamma type formula by the functional equation 
()A.2p . which yields 

^^' = FrT^' Res>-1, (3.5) 

while E = oo when s < —1. 

Of course, it would be silly to claim that p.Sp is a simplification of (|3.4p . 
but it shows that the uniform distribution has moments of Gamma type and 
thus belongs to the class studied here. 

We have p+ = oo, /?_ = —1, 7 = 7' = 0, 5 = —1, x = 0, Ci = 1. 

Example 3.4 (Beta distribution). Let -Bo,^ have the Beta distribution 
B(a,/3), where a,/3 > 0; then B^^fs has a density function f{x) = cx°'~^{l — 
x)^-\ < X < 1, where c = r(a)-^r(/3)-^r(a + /3), cf (IXSjl . (Note that 
a = /3 = 1 yields the uniform distribution in Example 13.31 as a special case.) 
Consequently, by (lA.Sp . for Res > —a, 

'r(Q)r(/3)\ -ir(s + a)r(/3) r(a + /3)r(s + a) 



EBl^ = J\^f{x)dx=[^^ 



\a + (3)J T{s + a + (3) r(a)r(s + a + /3) ' 

(3.6) 

while KB^p = cxd if s < —a. We have /3+ = 00, p_ = —a, 7 = 7' = 0, 
5 = X = 0, Ci = T{a + /3)/r(a). 

Example 3.5 (Chi-square distribution). The chi-square distribution 
X^in) is the distribution of Qn '■= J27=i ^1 ^ where Ni,N2, ■ ■ ■ are i.i.d. stan- 
dard normal variables. It is well-known, see e.g. [ol, Section n.3], that the chi- 
square distribution is a Gamma distribution, differing from the normalized 

version in Example 13.11 bv a scale factor; more precisely, Qn = 27^/2- Con- 
sequently, the chi-square distribution has moments of Gamma type, with, 
by dsn), 

EQ- =2- ^^"+;f\ Res>-n/2, (3.7) 
r(n/2) 

while = 00 for s < —n/2. We have p+ = 00, p_ = —n/2, 7 = 7' = !, 
S = (n- l)/2, x = log2, Ci = V2^/r{n/2). 

If n = 2, then Q2 = 2ri = 2T = T2, which also follows from p.7p and 



Example 3.6 (Chi distribution). The chi distribution x(^) is the distri- 
bution of Rn ■= {Y17=i ■^i)^^'^ ~ Qn'^ , with notations as in Example 13.51 
Hence, using (|3.7p . the chi distribution has moments of Gamma type, with 

ERi = EQt/' = r/'^^^^^±^, Res>-n, (3.8) 
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while ^Rfi = oo for s < —n. We have p+ = oo, p- = —n, 7 = y = 1/2, 
6 = {n-l)/2, x = 0, Ci = 2i-"/27rV2/r(n/2), cf. Remark [231 

In particular, the special case n = 1 shows that if G N(0, 1), then 
\N\ G x(l) has moments of Gamma type with 

E|iV|^ = 7r-i/22^/2r(s/2 + l/2). (3.9) 

Example 3.7 (F-distribution). The F-distribution is the distribution of 

Fm,n ■■= %^ = (3.10) 

where Qm S 'X^i^^) and Q'^ G X^{n) are independent. By (j3.7p . this has 
moments of Gamma type with 

tn\s ^„ , „ / n \ ■5r(s + m/2)r(n/2 — s) 

^K,n = - EQ^E Q'J-^ = - ^ ^, '') \ 3.11 

Vm/ Vm/ 1 (m/2jl [n/ 2.) 

for —m/2 < Res < ra/2, while EF^„ = 00 for s < —m/2 and s > n/2. We 
have p+ = n/2, /9_ = —m/2, 7 = 2, 7' = 0, 5 = (n+m— 2)/2, x = log(n/m), 
Ci = 27r(r(m/2)r(n/2))-^ (Cf. Remarks ES and EjOl) 

Example 3.8 (t-distribution). The t-distribution is the distribution of 

where G N(0, 1) and ii„ G x(^) &re independent. This random variable is 
not positive; in fact the distribution is symmetric. However, by (j3.10p and 

p.l2p . 7^ = Fi^n, so if we consider \Tn\ = ^i^n ^ we see from Example 13.71 
that \Tn\ has moments of Gamma type, with 

E ir 1^ - EF^/^ - ,^s,2 ns/2 + l/2)T{n/2-s/2) 

for —1 < Res < n, while E|7^|'' = 00 for s < —1 and s > n. We have 
p+ = n, p- = -1, 7 = 1, y = 0, (5 = (n - l)/2, x = |logn, Ci = 
23/2-"/2vri/2/r(n/2). (Cf. RemarkEE) 

Example 3.9 (Weibull distribution). The standard Weibull distribution 
has the distribution function 

¥{Wa < x) = 1 - 6-="" , x>0, (3.14) 

for a parameter a > 0, and thus density function ax°'~^e~^" , x > 0. 

Note that a = 1 yields the exponential distribution in Example l3.2[ More- 
over, for any a and y > 0, 

<y) = < = l-e-y = F{T < y), 

where T G Exp(l); hence = T and Wa = T^/". It follows from HiSl^i 
that Wa too has moments of Gamma type, see Remark 11.51 with 

E = E r"/° = r(s/a + l). Re s > -a, (3.15) 
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while EW^ = oo if s < —a. We have pj^ = oo, p_ = —a, 7 = 7' = 1/a, 



5 = 1/2, X = a ^ log a ^ ^ C\ = ^2tx ja^ cf. Remark | 

If a = 1, then obviously M^i = T € Exp(l). If a = 2, then W2 = T^/^ 4 
2-i/2gi/2 4 2-1/2^2, which also follows by comparing (IXT5|) and dSSD- 

Example 3.10 (Stable distribution). Let Sa be a positive stable random 
variable with the Laplace transform Ee"*"^" = e~*", with < a < 1. Recall 
that any positive stable distribution is of this type, for some a G (0, 1), up 
to a scale factor, see Feller @, Section XIII.6]. (We may also allow a = 1, 
but in this exceptional case Sa is degenerate with 5"! = 1 a.s.) 
For any s > 0, by (fAlOl) . 

00 /'OO 



r{s)ES-'= / t"~^Ee-'*"dt = / t'-'e"' dt, 
Jo Jo 

while the change of variables u = yields 

r f-'e-'" dt = - r u'/'^e-^— = a-'Tis/a). 
Jo oi Jo u 



Hence, 



_ TisM _ r(l + s/a) 



(In particular, this moment is finite.) Thus, for s < 0, 

Tffns r(l - s/a) 

r(i-.) • (^-'^^ 

We have shown ()3.16p for s < 0, but Theorem 12.11 (with = a and p- = 
—00) shows that (I3.16P holds whenever Re s < a, while E S*^ = 00 for s > a. 
(The case a = 1 is exceptional; E Sf = 1 for every real s, so (I3.16P holds but 
p+ = 00.) Thus 5*0 has moments of Gamma type. 

We have 7 = — 1, 7' = — (a~^ — 1), 5 = 0, x = log a, Ci = a~^/^. 

Example 3.11 (Mittag-Leffler distribution). The Mittag-Leffler distri- 
bution with parameter a G (0, 1) can be defined as the distribution of the 
random variable Ma '■= S~", where Sa is a positive stable random variable 
with E e"**^" = e~*" as in Example 13.41 Since Sa has the moments given 
by p.l6p . the Mittag-Leffler distribution too has moments of Gamma type 
given by, cf. Remark 11.51 



EM- = Eg-- = = , Res>-1, (3.17) 

al [as) 1 [as + 1) 

while EM^ = 00 for s < — 1. In particular, the integer moments are given 
by 

^M^= ■ n = 0,l,2,... (3.18) 

T[na + 1) 

We have p+ = 00, p_ = —1, 7 = 7' = ! — a, 5 = 0, x = —a log a, 
Ci = a"^/^, in accordance with Remark! 
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The reason for the name "Mittag-Leffler distribution" is that its moment 
generating function is, by (13.18p . 



n ™ n 

^EM:^ = ^ \ (3.19) 



jgg^M, _ ^^^^^ _ 

n=0 n=0 ^ ^ 



which converges for any complex s and is known as the Mittag-Leffler func- 
tion Ea{s) since it was studied by Mittag-Leffler [23,]. The formula (|3.19p . 
or equivalently (|3.18p . is often taken as the definition of the Mittag-Leffler 
distribution. 

We may also allow a = and a = 1, with Mq G Exp(l) (see Example l3.2p 
and Ml = 1; in both cases (ISTTll and (f3lB hold, although for a = 0, (I3T9I1 
converges only for |s| < 1, and 6 = 1/2, Ci = -v/27r, while for a = 1, ()3.17p 
trivially holds for all s with EM^ = 1 < oo and />_ = — oo. 

The Mittag-Leffler distribution was introduced by Feller [1], see also 0, 
Sections XI.5 and XIIL8(b)] and Pollard [26]; Blumenfeld and Mandelbrot 
[3] considered also log Mq, , which by (|3.17p has moment generating function 
r(s + l)/r(as + l) of Gamma type, and called its distribution the "logarith- 
mic Mittag-Leffler distribution" . Feller [1; showed that the Mittag-Leffler 
distribution is the limit distribution as t — )• oo of the number of renewals up 
to time t, properly normalized, of an i.i.d. sequence of positive random vari- 
ables belonging to the domain of attraction of a stable law. It emerges also, 
for example, as the limit distribution of occupancy times in the Darling-Kac 
theorem, see Bingham, Goldie, Teugels 0, Section 8.11]. 

In the special case a = 1/2, the duplication formula (IA.3P yields 

^Mlj, = ^^j^^ = + 1/2), (3.20) 

which by comparison with i^M) shows that M1/2 = V2\N\ with N G N(0, 1), 
which is equivalent to the well-known relation S1/2 = ^A^^^. 

Example 3.12 (A different Mittag-Leffler distribution). Another dis- 
tribution related to the Mittag-Leffler function Ea{s) in (|3.19p . and, rather 
unfortunately, therefore also called "Mittag-Leffler distribution" was intro- 
duced by Pillai [25|] as the distribution of a random variable with distri- 
bution function 1 — £^q,(— x"), where < a < 1; equivalently, by (|3.19p . 

P(La>2;) = ^„(-x°)=Ee^^'"^". (3.21) 

This is another instance of the relation (jl.lOp , and Lemma 11.111 shows that 
La has moments of Gamma type with, using ()3.17p . 

ELi = Tis/a + 1) E M^/" = ^ + s/a)ni - s/a) ^ -a < s < a, 

r(i - s) 

(3.22) 
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while EL* = oo if s < —a or (provided a < 1) s > a. Note also that 
Lemma 1 1 . 1 1 1 yields the representation [IH] 



L„ = T^/^M-i/" = ri/"5a, (3.23) 

with T G Exp(l) and the stable variable Sa independent. Equivalently, 

see Example 13.91 = WaSa^ with the Weibull variable and Sa inde- 
pendent. It follows easily from ()3.23p that Lq has the Laplace transform 
Ee"*-^" = (1 + t")-i, t > di]. 

For a = 1, we have L\ G Exp(l). For < a < 1, /9+ = a, p_ = —a, 
7 = 2/a - 1, 7' = 1, (5 = 1/2, X = 0, Ci = \/2^/a. (For example by 
Remark Eini) 

Example 3.13 (Pareto distribution). The Pareto(a) distribution, where 
a > 0, is the distribution of a random variable with P(Pq. > x) = x~", 
x > 1. Hence Pq, has density function ax~'^~^ ^ x > 1. Direct integration 
shows that the moments are of Gamma type and given by 



00 



EP^= / ax*-"-i = = — I^, Res<a. (3.24) 

Ji a — s T[a — s + 1) 

Hence /?+ = a, p_ = —00, 7 = 7' = 0, (5 = —1, x = 0, Ci = a. 

We have Pa = C/^^/" with [/ G U(0, 1), so alternatively these result follow 
from Example 13.31 and Remarks 11.51 and 12.91 

Example 3.14 (Shifted Pareto distribution). The shifted Pareto vari- 
able Pa '■= Pa — li where a > 0, has support (0,oo) and density function 
a{x + 1)""^^, X > 0. The moments are given by, using ()A.9p . 

r(s + i)r(a -s) _ r(s + i)r(a - s) 

r(a + 1) ~ f(a) ' 

(3.25) 



EP^ = J ax'ix + iy-^ =a- 



for —1 < Res < a, while EP^ = 00 if s < — 1 or s > a. Hence also 
the shifted Pareto distribution has moments of Gamma type, with = q, 
p_ = -1, 7 = 2, 7' = 0, (5 = a, X = 0, Ci = 27r/r(a). 

For a^= 1, (frojl yields EPf = r(l + s)r(l-s) = EPf hence Pi = Pf ^ 
(so log Pi has a symmetric distribution) . Using ()A.6P , we have 

— ITS 

EPf = r(l + s)r(l -s) = sr(s)r(l -s) = — — , -1< Res < l. 

sin(7rs) 

Further, comparing (I3.25P and (j3.1ip we see that Pi = P2,2- 

More generally, (13:25]) and ([33]) imply that if Fi G r('l) = Exp(l) and 
G F(a) are independent, then E(ri/r'„)* = EFf E(r'„)-* = EP^ (for 

suitable s); thus Pq = Fi/F'^ by Corollarv 12.31 This is also an instance of 
Lemma [LTT] (with a = 1 in pTfo]) and (fTTTT]) ). 
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Example 3.15 (Extreme value d istributions). There are three type s of 



extreme value distributions, see e.g. iLeadbetter. Lindgren and RootzenI [21 



Chapter I]. We let Xj, Xjj^a, Xjjj^a denote corresponding random variables; 
they have the distribution functions 

P(X/ < x) = e"^"", -oo<x<oo, (3.26) 

F(^//,a < a;) = e"^"", < x < oo, (3.27) 

F(X///,„ < x) = e-^-"^')", -oo<x<0, (3.28) 

where (for types II and III) a > is a real parameter. 

The distribution ()3.26p (the Gumbel distribution) has the entire real line 
as support, and is therefore not qualified to have moments of Gamma type. 
It has, however, moment generating function of Gamma type, see Exam- 
ple EIH] 

The distribution (j3.27p (the Prechet distribution) satisfies, with T G 
Exp(l), 

F(^//,a < a;) = P(r > X-") = P(T"V" < 2;)^ x> 0, 

and thus Xjj^a = T~^/" = l/Wa, see Example 13. 9[ Hence it has moments 
of Gamma type with, see (13. 2p and (I3.15p . 

EX|j„ = r(l - s/a), Re.s<a. (3.29) 

We have p+ = a, p- = —00, 7 = 1/a, 7' = — 1/a, S = 1/2, x = a~^loga, 
Ci = y^27r/a, cf. Remarks 12.81 and 12.91 and Examples 13.21 and 13.91 

The distribution (j3.28p satisfies F{—Xjji^a > x) = e^^" , x > 0, so 

—Xni^a = Wa and Xm^a = —Wa, see Example 13.91 By (j3.15p . \Xjjj^a\ = 
—Xjii^a has moments of Gamma type with 

^\Xiii^^\' = T{1 + s/a), Res>-a. (3.30) 

We have p+ = 00, p- = —a, 7 = 7' = 1/a, S = 1/2, x = a^^loga^^, 
Ci = y/27r/a. 

We have so far considered distributions with moments of Gamma type; 
we now turn to a few examples with moment generating function of Gamma 
type. Of course, if X is any of the examples above, logX yields such an 
example. (One such example was mentioned in Example 13.111 ) 

Example 3.16 (Exponential distribution again). We noted in Exam- 
ple 13.21 that T G Exp(l) has moments of Gamma type. It has moment 
generating function of Gamma type too, since 

sT _ „sx-x -i^ _ 1 _ r(l — s) 



Ee'' = e^^-^dx = - = -)- {, Res<l. (3.31) 

JO 1 — s r(2 — s) 

In fact, T = —logU = log Pi, and equivalently U = and Pi = e^; 
compare (131311) to (f33l) and (f3724]) . We have p+ = 1, p_ = -00, 7 = 7' = 0, 
5 = -1, X = 0, Ci = 1. 
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Example 3.17 (Gamma distribution again). A Gamma distributed ran- 
dom variable r„ G T{n) with integer n > 1 can be obtained by taking the 
sum of n independent copies of T G Exp(l), and thus (]3.3ip implies that r„ 
has moment generating function of Gamma type with 

Ee^^" = (Ee-n" = = ~ 'l\ Res<l. (3.32) 

^ ^ (1-s)" r(2-s)"' ^ ^ 

We have p+ = 1, p- = — oo, 7 = 7' = 0, 5 = — n, x = 0, Ci = 1. 

More generally, for any real a > 0, has moment generating function 
jggsro, — (^i _ 5)-"_ If Q, ig not an integer, then this function has a singu- 
larity as s 1 that is not a pole; hence Ee*'"" cannot be extended to a 
meromorphic function in the complex plane, and Fq, does not have moment 
generating function of Gamma type. Consequently, the Gamma distribution 
F(a) has moment generating function of Gamma type if and only if a is an 
integer. 

Example 3.18 (Gumbel distribution). If Xj has the Gumbel distribu- 
tion i^M), and T £ Exp(l), then 

F{e-^' >x)= F{Xi < - log x) = e"^ = P(T > x), x > 0, 

so e~-^' = T and X[ = — log T. Consequently, the Gumbel distribution has 
moment generating function of Gamma type with, see (j3.2p . 



Ee*^^ = ET~^ = F(l - s). Res < 1. (3.33) 

We have p+ = 1, = —00, 7 = 1, 7' = —1, 6 = 1/2, x = 0, Ci = \/2tt. 

Example 3.19 (Levy area). The Levy stochastic area is defined by the 
stochastic integral At := /q XudYu — Jq YudX^, where (X^,!^), n > 0, is 
a two-dimensional Brownian motion starting at (i.e., X^ and Y^, u > 0, 
are two independent standard Brownian motions). By Brownian scaling. 



d 



Af = tAi, so we consider only A := A\. Then, for real t, see e.g. iProtter 
[ii. Theorem 11.43], using (IXHl) . 

Ee"^ = ^7T = = . ■ , = + -^^^^ ~ (3.34) 

cosh(tj cos(it) sin(-2 + it) ir 

Consequently, by Theorem l2.H A has moment generating function of Gamma 
type, with p± = ±tt/2 and 

Ee'^ = ^ = -^^—^^ ^, |Res|<7r/2. (3.35) 

cos S IT 

We have 7 = 2/7r, 7' = 0, (5 = 0, x = 0, Ci = 2. 

It is known th at A has the density function 1/2 cosh(7rx/2), —00 < x < 00, 



see e.g. iProtteii 28l . Corollary to Theorem 11.43] and Example 16.181 below. 
Of course, has moments of Gamma type, and so has e^"^ for every real 

c. A comparison with (|3.1ip shows that e'^"^ = -Fi,i. Hence, A = vr^^ logFi^i. 
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Remark 3.20. We have shown that a large number of classical continuous 
distributions have moments of Gamma type, but there are exceptions. For 
example, if X G U(l, 2), then EX" = (2''+^ - l)/(s + 1) has complex zeros 
at —1 + 27riA;/ log 2, k = ±1, ±2, . . . , which is impossible when (jl.ip holds. 
More generally, if X is non-degenerate and is supported in a finite interval 
[a, 6] with < a < 6 < oo, then EX* is an entire function of s, which by 
Theorem 14.11 below shows that X does not have moments of Gamma type. 

4. Poles and zeros 

In this section it will be convenient to consider the class J- of all functions 
of the type in (jl.ip and (|1.2p . regardless of whether they equal EX* [Ee*^] 
for some random variable X \Y] or not. Thus, J- is the set of functions 

F{s) = CD'^^p^—^ ^, (4.1) 

nf=ir(a;. + 6',)' 

where J,K>0 and C, D, aj, bj, a'^, 6'^ are real with D > and aj ^ 0, 
a'^ 7^ for all j and k. We let Jv, C be the set of such functions that 
appear in ^J^j and ([L2]), i.e., the set of F(s) G T such that F{s) = EX* 
for some positive random variable X and s in some interval. 

A function F{s) G is a meromorphic function of s in the complex plane 
C. We can easily locate its poles (and zeros) precisely as follows. Define 
u{s) = vpis) for all s G C by 

m \i F has a pole of order m at s, 
^f{s) = \ —m if F has a zero of order m at s, (4-2) 
otherwise (i.e., F is regular at s with F{s) ^ 0). 

(For F G J-rn with F{s) an extension of EX*, we also write I'x-) 

Since D* has neither poles nor zeros, while r(2;) has a simple pole at each 
z G Z<o := {0, —1, —2, . . . } but no zeros, 

J K 
vf{s) = ^ + bj G Z<o] - ^ l[a';jS + b'f^ G Z<o] 
i=i k=i 

j=i fc=i « 

(4.3) 

Note that all poles and zeros of F lie on the real axis. 

We further define := {F £ F : upiO) = 0}, i.e., the set of functions 
F £ F that have neither a pole nor a zero at 0. By Remark 12.41 Fm C Fq C 
F. Note that is a group under multiplication and that Fq is a subgroup. 

For F G Fm we defined p± in Section E] the definition (12. ip can be written 

/3+ := minjx > : vpix) > 0|, 

; \ V (4.4) 

/3_ := maxjx < : fpyx) > 0|. 
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For general -F G we define 

/3+ := min{x > : i^f{x) ^ 0}, 

r / X / 1 (4-5) 

:= maxjx < : lypix) 0}, 

and note that this is consistent with (I4.4p for F G Tm by the fact (Theo- 
rem [2]T]) that such F has no zeros in p+) and no pole at 0. 

If all aj,a'i^, bj, b'^ > 0, then F{s) has no poles or zeros in the right halfplane 
Res > 0, since none of the factors in (j4.ip has; thus p+ = oo. Similarly, 
if all aj,a'j^ < and bj,b'f^ > 0, then F{s) has no poles or zeros in the left 
halfplane Res < and p_ = — oo. The converses do not hold, because the 
representation (j4.ip is not unique and we may, e.g., add cancelling factors 
that separately have poles at other places. However, we may always choose 
a representation of the desired type; this is part of the following theorem. 

Theorem 4.1. Let F ^ Tq and let p± be as in (|4.5p . 

(i) It is always possible to find a representation (j4.ip of F{s) with all 
bj,b',>0. 

(ii) // p- = —oo, then F{s) has a representation (j4.ip with allaj,a'f^ < 
and bj, b'^. > 0. 

(iii) If p+ = oo, then F{s) has a representation (14. ip with all aj,a'f^,bj, 

K > 0. 

(iv) If p+ = oo and p_ = — oo (i.e., F{s) is entire and without zeros), 
then F{s) = CD'^ for some real constants C and D > 0. 

In particular, if X is a random variable with moments of Gamma type, 
this applies to the meromorphic extension F{s) o/EX*. In this case, it is 
not possible that both p^ = oo and p- = —oo (i.e., that EX* is entire), 
except in the trivial case X = D a.s. for some D > (and thus EX** = D^). 

We begin by proving a lemma. 

Lemma 4.2. Suppose that aj,a'-,bk,b'j^ are real with aj,a'^ > and that 
^i^) •= n/=i rlajS + Ha^i r(a'^s + 6'^) is analytic and non-zero in a 
half-plane Res < B for some B G (—00,00). Then F{s) = e"^Q{s) for 
some rational function Q with real poles and zeros and some a G M. 

Proof. Say that two non-zero real numbers a and a' are commensurable if 
a/ a' G Q; this is an equivalence relation on M* := M \ {0}. (In algebraic 
language, the equivalence classes are the cosets of Q* in M*.) The poles 
of r(as + b) are regularly spaced with distances l/\a\. Thus, if a and a' 
are incommensurable, and b,b' are any real numbers, then r(as + b) and 
r(a's + b') have at most one common pole. 

We divide the set {aj}/=iU{a'^}|^j^ into equivalence classes of commensu- 
rable numbers. This gives a corresponding factorization F{s) = Y[e=i ^ii^) 
where L is the number of equivalence classes and each F£ is of the same form 
as F but with all aj and a^, commensurable. It follows that two different 
factors F^^ (s) and Fg^ (s) have at most a finite number of common zeros or 
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poles; hence, by decreasing B, we may assume that there are no such com- 
mon poles or zeros with Res < B. Hence, a pole or zero of a factor F£(s) 
in Res < B cannot be cancelled by another factor, and thus such poles or 
zeros do not exist. Consequently, each factor Fi{s) satisfies the assumption 
of the lemma, and we may thus treat each Fi{s) separately. This means 
that we may assume that all aj and are commensurable. 

In this case, there is a positive real number r such that all aj and 
are (positive) integer multiples of r. Using Gauss's multiplication formula 
(|A.5[) . we may convert each factor T{ajS + bj) or T{a'f^s + 6'^) into a product 
of a constant, an exponential factor e^*, and a number of Gamma factors 
r(rs + Ui) with Ui € M. Using the functional relation ()A.2p . we may further 
assume that each Ui G (0, 1], provided we also allow factors (rs + u)^^ with 
u G R. Collecting the factors, we see that 

F{s) = e-Q(s)^^^^i-^ ^ (4.6) 



nfc=i r(rs + u[ 



k> 



for a constant a, a rational function Q{s) with real zeros and poles, and 
some Uj,u'f^ £ (0)1]- We may assume that Q has no poles or zeros with 
Res < B (by again decreasing B if necessary). The factors r(rs + uj) and 
r(rs + u'f^) have no zeros but each has an infinite number of poles with 
Res < i?, and two factors r(rs + Uj) and r(rs + u'^) have disjoint sets of 
poles unless uj = u'^. Since the poles with Res < must cancel in (j4.6p . 
this shows that the Gamma factors must cancel each other completely, and 
thus ^Mi reduces to F{s) = e°'^Q{s). □ 



Proof of Theorem\4.1\ (i) : Using T{z) = T{z + l)/z repeatedly on any term 



with bj < or 6'^ < 0, we may write F{s) as 

nf_i r(a,s + bi) 
CD^Q(s) ^V (4-7) 

nf=ir«s + 6',)' 

with bj,b'f^ > 0, where Q{s) is a rational function with only real poles and 
zeros; Q{s) = cY\^{s — ri)/Y\g{s — r'^) for some real rj and r^, i = 1, . . . ,/ 
and ^ = 1, . . . , L, say; we may further assume that ^ for all i and ^. 
Since is not a pole or zero of F, it is by (|4.7p not a zero or pole of Q, and 
thus all Ti, / 0. 
If r < 0, then 

,-. = , + H = IVtM+_H, (4.8) 

r(s + \r\) 



and if r > 0, then 



r(-s + r + l) , 



so Q{s) may be written as product of quotients of Gamma factors of the 
desired type (and a constant), and thus the result follows from (j4.7p . 
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(ii) We use (i) and may thus assume that ()4.ip holds with 6j, 6'^ > 0. We 
factorize F(s) as, with d = logD, 

F{s) = Ce'^'F+{s)F_{s), (4.10) 

where -F+(s) contains all factors T{ajS + bj) and r(a'^,s + 6'^) with aj,a'^ > 0, 
and -F-(s) contains the factors with aj, a'j^ < 0, so F_ is of the desired form. 

Since bj,b'f, > 0, -F-(s) has no poles or zeros with Res < 0. By as- 
sumption, /9_ = — oo, and thus F{s) is analytic and non-zero in the half- 
plane Res < 0. Consequently, by (I4.10p . -F+(s) also has no poles or ze- 
ros in Res < 0. By Lemma 14.21 -F+(s) = Q{s)e°"^ for a rational function 
Q{s) = Ci Wji^s — Uj) / Wj^{s — Vk) where Uj and Vk are real. We may assume 
that Uj 7^ Vk for all j, /c, and then each Uj or Vk is a zero or pole of -F+(s), 
and thus all Uj^Vk > 0. Using ()4.9p . we thus can write Q[s) in the desired 
form; hence -F+(s) and F{s) can be so written. 



(iii) 



(iv) 



Follows from (ii) by replacing F{s) by F{—s). 



In this case, F{s) is an entire function without zeros. We use 



again the factorization (|4.10p . By the proof of (ii) , -F+(s) = e"^(5(s) for 



a rational function Q. By symmetry, as in the proof of (iii) , similarly 
F-(s) = e°'~^Q-(s) for another rational function Q_. Thus, 

F{s) = C7e('^+"+"-)"Q(s)Q_(s). (4.11) 

Hence, the rational function Q{s)Q-{s) is entire and has neither poles nor 
zeros; consequently, it is constant. Thus F{s) = Cie'^^^ for some Ci and 
di. □ 

As a consequence we show that the function vpis) describing the poles 
and zeros of F{s) essentially determines F, and thus the distribution of X 
and Y satisfying or (fOl) . 

Theorem 4.3. If Fi,F2 G F and vp^ = up^, then F2{s) = cD^Fi{s) for 
some real constants C ^ and D > 0. 

Proof. F := F2/F1 G F and h'pis) = i^Fiis) — t^F2{s) = for every s. 
Hence, F £ Fq and p_ = — c«, p+ = c«; thus Theorem 1^ Tiv) shows that 
F(s) = CD'. □ 

Corollary 4.4. // Xi and X2 are positive random variables with moments 

of Gamma type and ux^ = 1^X2) then X2 = DXi for some constant D > 0. 
In other words, a distribution with moments of Gamma type is uniquely 
determined up to a scaling factor by the function uxis). 

Similarly, ifYi and Y2 have moment generating functions of Gamma type 

with the same v, then Y2 = Yi + d for some real constant d. 

Proof. Let Fj{s) be the meromorphic extension of ]EX|, j = 0,1. Then 
F2(s) = CD'^Fi{s) by Theorem Setting s = we find C = 1, and 
thus, for s in some interval, IEX| = F2{s) = D'Fi{s) = '&{DXiY, whence 

X2 = DXi by Corollary 
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The final statement follows by considering Xj := e . □ 

Remark 4.5. The proofs of Theorem 14.11 and Lemma 14.21 yield an almost 
canonical way of expressing F{s) S J-q in the form ()4.ip . We start by making 
all bj, b'l^ > by Theorem 14. ]]ri)[ We then treat positive and negative aj and 

separately; furthermore, if these coefficients are not all commensurable 
(which they are in most natural examples), we separate them into different 
equivalence classes of commensurable coefficients. For each class we then 
rewrite the product of the corresponding factors in the form (14. 6p for some 
real r (different for different classes, and chosen with |r| as large as possible). 
Note that different factors in ()4.6p have no common poles, so it is easy to 
locate all poles and zeros. It only remains to take care of the rational part 
in (|4.6p : in the examples we know, this is not a problem but we have not 
studied this in general, and we do not know whether it is possible to use this 
approach to define a unique canonical representation ()4.ip for each F; we 
leave this as an open problem. (Alternatively, it might be possible to define 
a canonical representation including a rational factor.) 

See Theorems 11.61 and 11.121 for examples of such 'canonical' versions, but 
note that they not necessarily are the simplest by other criteria. 

Let N+{x) := Eo<s<x ^i^l^)' ^ > 0' and iV_(x) := Ex<s<o ^i^(^)' ^ < 0- 
Thus N^(x) is the total number of poles minus the total number of zeros 
(with multiplicities) in the interval (0, x], and similarly for N-{x) and the 
interval [x, 0) on the negative half-axis. The following proposition can be 
interpreted as giving the density of poles minus zeros on the positive or 
negative half-axis. 

Proposition 4.6. Let N^{x) := Ylo<s<x^Fi^)> x > 0, and N^{x) := 
Ylx<s<o^p(^)' X < 0. Then N^{x)/x — ^(7 — 7') as x ^ +00 and 
N^{x)/\x\ — )■ i(7 + 7') as X ^ —00. 

Proof. Use, for simplicity, a representation as in Theorem l4.]](i)[ Then, using 
(j4.3p . the terms with Oj > and a'^ > give no contributions to z^_p(s) and 
N^(x) for s > and x > 0, while each aj < gives a contribution \aj\x + 
0(1) to N+{x) (poles regularly spaced at distances l/|aj|), and similarly 
each a'j^ < gives a contribution — |a'^|x + 0(l) to N+{x). Consequently, for 
X > 0, using Lemma |2. 121 

iV+(x) = x(^ \aj\- ^ |a',|)+0(l) = xl(7-7')+0(l), 

j:aj<0 k:a'^<0 



and the result as x — t- 00 follows. The result as x — ?• — 00 follows similarly, 
or by replacing F{s) by F{—s). □ 
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5. ASYMPTOTICS OF MOMENTS OR MOMENT GENERATING FUNGTION 

In this section we assume that X > and Y = log X are random variables 
such that ([ri])-(ir3]) hold (for p_ < Res < /)+ and t G M), i.e. 



nf=i r(a',s + 6- 



EX' = Ee'^ = F{s) = CD' ^^-\] ] ^, (5.1) 



and we write as above D = e . Recall the definitions (|2.4p - (|2.8p . 

We begin with asymptotics of F along the imaginary axis and close to it. 

Theorem 5.1. As t ^ ±00, 

|Ee'*^| = |F(it)| ~Ci|t|'^e-f^l*l. (5.2) 

Moreover, for any fixed real a, and uniformly for a in any bounded set, 

\F{a + it)| ~ e^'"|tr''^|F(it)| ~ C7ie^'^|t|''+^''^e- 5^1*1 (5.3) 

Proof. It is an easy, and well-known, consequence of Stirling's formula, see 
e.g. (IA.13j) . that for any complex constant c and all complex z in a sector 
|arg2;| < vr — e (where e > 0) with \z\ large enough, for example \z\ > 
2\c\/ sine, 

logr(z + c) -logr(z) = clogz + 0(|zr^), (5.4) 

uniformly for c in any bounded set and such \z\. 

If a > and 6 G M, we thus have for real t — t- +00, taking z = iat in ()5.4p 
and in Stirling's formula (IA.12p . 

logr(ait + b) = logr(iat) + 61og(iat) + 0(t"^) 

= {iat + b-^) log(iat) - iat + log V2tt + O {t~^) 

= (iat + 6 - i)(log(at) + i7r/2) - iat + log \/27r + 0(t"^) . 

Taking the real part, we find 

log |r(ait + 6)1 = Re (log r (ait + b)) 

= -|at + (6- i)log(at) +log\/2^ + 0(t"^). 

Consequently, for a > 0, 

|r(ait + 6)| ~ ^/2^a^-i/¥-i/2g-fai^ t ^ +00. (5.5) 



For general real a and t we thus have (by T{z) = T{z)) 
|r(ait + 6)| = |r(|a|i|t| +6)1 ~ \/2^ |a|*-^/2|^|^-i/2g-f H|t|^ t ^ ±00. 

The result (j5.2p follows by multiplying the various factors in F(it) in (j5.ip . 
noting that \D^^\ = 1. 

For (|5.3p we note that ()5.4p implies 

log|r(a((T + it) + 6)1 - log|r(ait + 6)1 = Re(a(T log(ait + 6) + 0(r^)) 

= (T(alog \a\ + alog |t| + 0(t~^)), 
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and the result follows by multiplying the various factors in F{a + it)/F{it). 
(Alternatively, at least for fixed a, we may apply (15.21) with bj replaced by 
bj + aaj, b'j. replaced by 6'^ + cia'^ and C replaced by CD"^ = Ce'^"; note 
that the proof holds for any function F of this type, without assuming the 
existence of random variables X and Y .) □ 

Proof of Proposition \27^ By (15. 2p . the values of Fiit) determine 7, 5 and 
Ci. Further, choosing any fixed cr > in (15. 3p . we see that F determines 7' 
and X too. □ 

Corollary 5.2. We have 7 > 0. Further, if j = 0, then 6 < 0. 

Proof By letting t co in ()5.2p . since | Ee'*^| < 1. □ 

Remark 5.3. If 7 = and 7' 7^ 0, then ()5.3p implies a better bound for 
5. However, we do not know any such example, and we leave it as an open 
problem whether there exists any X with 7 = and 7' 7^ 0. 

Theorem 5.4. // 7 > 0, then X and Y are absolutely continuous, with 
continuous and infinitely differentiahle density functions fx{x) on (0, 00) 
and fviy) on {—00,00) given by 

1 /'cr+ioo 

fx{x) = — x-'-^Fis)ds, (5.6) 



27ri 
1 
27ri 



CT— 100 

t-ioo 



fYiy) = ^l e-y'Fis)ds, (5.7) 



for any a G (p-,p+). 

Proof. By Theorem 15.1^ the characteristic function Ee'*^ = F{it) is inte- 
grable, and thus Y has a continuous density fy obtained by Fourier inver- 
sion: 

fviy) = IT / e-'*^F(it) dt = — e-^ypis) ds. (5.8) 
Since y = logX, X also is absolutely continuous, with the density function 



100 



fxix) = -fY{logx) = ^ I x-'-^Fis)ds. (5.9) 



100 



x 27ri 

(Alternatively and equivalently, F{s) is the Mellin transform of fx, and this 

is the Mellin inversion formula.) 

Since Theorem 15.11 further implies that \t\^F{it) is integrable for every 
^ 0, /y and fx are infinitely differentiahle and we may differentiate ()5.9p 

and (j5.8p under the integral sign an arbitrary number of times. 

The integrands in (15. 9p and (j5.8p are analytic in s for /3_ < Res < p+, 

and thus the estimate (j5.3p implies that we can move the line of integration 

to any line Re s = a with < a < p^. □ 

Remark 5.5. For X, we consider the density only for x > 0, and 'infinitely 
differentiahle' here means on (0,oo). Continuity and differentiability of fx 
at will be considered in Theorem 16.111 
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Remark 5.6. In the case 7 = 0, the same argument shows that if 6 < —1, 
then X and Y have continuous density functions, which have at least [|(5|] —2 
continuous derivatives. However, Example 13.41 where S = —f3, shows that 
we in general do not have more derivatives. Similarly, Examples 13.31 and 13.41 
show that we do not necessarily have continuous density functions for 7 = 
and — 1 < 5 < 0. Example 110.11 gives an example with ^ = 6 = where the 
distribution is mixed with a point mass besides the absolutely continuous 
part. 

Note that, by 7 = 5 = if and only if |EX"| = |Ee'*'*"| has a 

non-zero limit as t ^ ±00; by the Riemann-Lebesgue lemma, this implies 
that Y and X do not have absolutely continuous distributions. 

We next consider asymptotics of F along the real axis, when possible. 

Theorem 5.7. (i) // p-^- = 00, then for real s — )• +00, 

EX' = Ee'^ = F{s) ~ C7^s'5e^"i°s"+(^-^)^ (5.10) 

(ii) If p- = 00, then for real s — )• —00, 

EX' = Ee'^ = F{s) ~ C7l|s|^e^l"l'°§l^l+(^+T)^ (5.11) 

Proof, (i): By Theorem 14.11 and Proposition 12.71 we may assume that all 
aj,a'j^ > 0. We then argue as for Theorem 15. li If a > and 6 G M, then for 
real s — )■ +00, 

logr(as + b) = logr(as) + 61og(as) + 0(s~^) 

= (as + 6 - i) log(as) - as + log V2tt + O (s^^) 

= as log s + (a log a — a)s + (6 — ^) log s 

+ (6- i)loga + log\/2^ + 0(s~i), (5.12) 

and the result follows again by multiplying the factors. 

(ii): This follows from (i) by replacing Y by —Y, see Remark 12.81 

Ee'^^ = Eel^K-^) ~ C'i|s|'^e^l^l 7)l«l. □ 

If /9+ < 00, then F has poles, and possibly zeros, on the positive real axis. 
Typically, there is an infinite number of such poles (but see Example l3.3l for a 
counter example), and then we cannot consider asymptotics for all s — )• +00. 
However, we can restrict s to a subset of M and obtain asymptotic results 
similar to Theorem 15.71 in this case too. 

Lemma 5.8. Given real aj,bj,a'i^,b'j, for 1 < j < J and 1 < k < K , with 
aj,a'f, 7^ 0, there exists a closed set E cM and a constant ^ > such that 
E D I has measure greater than 1/2 for every interval I of length 1, and 
I sin(7r(ajS + bj))\ > ^ and \ sin(7r(a'^s + &'^))| > ^ for every j and k and all 
s£E. 

Proof. Let be the set of all (real) s such that ajs + bj G Z for some 
j or a'l^s + 6'^ G Z for some k. There exists a constant M such that no 
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interval of length 1 contains more than M points of N. (For example, 
M = J + K + J2j lajT"^ + Efc Wk\~'^-) It follows that E := {x : \x - s\ > 
1/(2A/ + 3) for all s G N} satisfies the properties, for some > 0. □ 

In the sequel we let E denote this set, defined for a given representation 
()5.ip of F{s). By considering only s £ E, we can extend Theorem 15.71 to 
arbitrary F. 

Theorem 5.9. For real s — t- ±00 with s G E, 

\F{s)\ = islV'^^^^sl'l+^^-^'^'+^W. (5.13) 
Proof. If a < and 6 G M, then for real s +00, by (IA.6P and <\5.12L 
log|r(as + 6)| = - log|r(|a|s - 6+ 1)1 + logvr - log | sin(7r(as + 6))| 
= — |a|s log s — (|a| log \a\ — \a\)s — (i — 6) log s — {I — b) log \a\ 



+ logy^-log|sin(7r(as + 6))| +0(s 

as log s + (a log \a\ — a)s + (6 — ^) log s — log | sin(7r(as + b))\ + 0(1). 

(5.14) 



If (a, 6) is some {aj,bj) or (a'^,6'^) with a < 0, we thus have by Lemma [5^ 
for s G £^ with s — >■ +00, 

log|r(as + 6)| = aslogs + (alog|a| - a)s + (6- i)logs + 0(l). (5.15) 

By (I5T2I1 . (f05]) holds also for a > (and ah s +00). 

Further, replacing s by — s and a by —a in (j5.15p . we see that if (o, b) is 
some {aj,bj) or (0'^,^^), then for s G with s — t- — c«, 

log \T{as + 6)1 = as log \s\ + (a log \a\ - a)s + (6 - i)log \s\ + 0(1). (5.16) 

Thus (I5.16P holds for all such (a, b) and s — )■ ±00 with s £ E, and the result 
follows from (15.111. □ 



Note that if p+ = 00, then 7' = 7, while if /9_ =00, then 7' = —7 
by (|2.4p ~ (j2.5p together with Theorem 14.11 and Proposition 12.71 hence the 
exponents in Theorems 15.71 and 15.91 agree (as they must). 

For complex arguments, we will use the following estimate. 

Lemma 5.10. Let ^'((T, t) := arctan(u/(T) dn for t > 0. Then, for a > 
with a £ E and all real t, 



\Fia + it)\ 

= exp 



\F{a) 



(-^(7 - 7)1*1 - 7 ^(^, \t\) + 0{1 + \t\a-')) . 



Proof. We may assume t > 0. Consider first a factor T{as + b) with a > 
and s = a + it, a > 0. (We may assume that a is large so that aa + b > 0, 
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e.g. by using ()5.3p for small a.) By ()A.13p . 

4- log \T{a{a + it) + 6)1 = Re logr(a(fT + it) + h) 
at at 

= Re(iolog(a((j + it) + h)) + 0{\a\~^) 
= Re(ialog(a((j + it))) + 0(|ct|"^) 
= -aIm(log(a + it)) +0(|(Tri) 
= -aarctan(t/cr) + 0(|o-|~^). (5.17) 
Consequently, integrating from to t, 

log|r(a(o- + it) + 6)1 -log|r(ao- + 6)| = -a^{a,t) + 0{ta-^). (5.18) 
If a < 0, we argue as in the proof of Theorem 15.91 and have by ()A.6P 

log|r(a(a + it) + 6)| 

= -log|r(|a|(a + it) + 1-6)1 - log | sin(7r(a(CT + it) + 6))| +log7r. 

If further (a, 6) = {aj,bj) or (a'^,6'^) for some j or k, and a £ E, then 
log I sin(7r(a((7 + it) + 6))| = 7r|a|t + 0(1), and it follows, using (|5.18|) with 
\a\ instead of a, that 

log|r(a((T + it) + 6)1 -log|r(ao- + 6)| = |a|^'(cr,t) - 7r|a|t + 0(1 + tcr"^) 

= -a^((T, t) + vrat + 0(1 + ta'^). 

The result follows by multiplying the factors in F, using Lemma 12.121 □ 

6. ASYMPTOTICS OF DENSITY FUNCTION 

We continue to assume that X and Y = log X are random variables such 
that dLlD-dO]) hold; as above we write EX' = e'^ = F{s). We assume 
7 > 0, so that density functions of X and Y exist by Theorem 15.41 and 
consider asymptotics of the density function /x(x) as x — )• or x — )• cxd, or 
equivalently of /y(y) as y — >• — oo or y — )■ oo. By symmetry it suffices to 
consider one side, and we concentrate on x — )• oo, but for convenience in 
applications we write most results for both sides and for both X and Y. 

We consider first x — )• oo (y — )• oo) and begin with the case p+ = oo, 
when X has moments of all (positive) orders and fx decreases rapidly 
(as we will see in detai l soon). We use the saddle point method, see e.g. 
Flajolet and Sedgewickl 1^ . Chapter VIII], in a standard way. 



Theorem 6.1. Suppose that = oo and 7 > 0. Then 

/x(x) ~ C72X^i-^e-^2x'^\ x^oo. 



where 



Cl := (<5 + l/2)/7. 



C2 := 76 
Ci 
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Proof. By Theorem l4.1l and Proposition l2.7l we may assume that all aj,a'j^, bj, 6'^ > 
0. We will use ()5.6p . which now is valid for all x > and o" > 0. 
By (|Al3]) and (lAHIl . for a, & > and Re s > 0, 

(logr(as + &))' = alog{as + b) + 0{\s\-^) = alog(as) + 0{\s\-^), 
{logT{as + b))" = ^ + 0{\s\-^). 

Consequently, writing 

J K 
f{s) := log F{s) = log C + ds + ^ log r(a,s + b^) - ^ log r(a'fcS + b'^), 

j=i k=i 

we have for Re s > 0, 

J K 
f'{s) = d + ^{aj\ogaj +ajlogs) - loga'^ + 4 logs) + 0(|s|"^) 

j=i k=i 

= x + 7logs + 0(|s|"^), 

ns) = i+o{\sn. 

s 

Fix X > and let G{s) := x~'^~^F{s) and ^((s) := logG(s) = — (s — l)logx + 
f{s). Then 

g'{s) = f'{s) — logx = 7logs + X — logx + ©(Isl^""^). (6.1) 

We choose (for x large) a = e^'^^^~^)h ^ so 7log cr = logx — x and g' {o) = 
0((T~^); thus a is an approximate saddle point of G{s). Note that cr — )• oo 
as X — )• oo, so — )• 0. Since g"{s) = f"{s), we further have, as x — )• oo, 

/(a) =7cj~^ + 0(cj-2) ^^cj-^ (6.2) 
Further, on the line Res = a, 

g'\a + it) = r\a + it) = ^ + 0(ct-2) = 2 + 0((1 + |t|)a-2). (6.3) 
Consequently, Taylor's formula yields 



and, uniformly for |t| < a^'^ 



g{a + it) = g{a) + 0{\t\a-') - ^t' + 0{i\t\' + \tf)a-') (6.4) 



G{a + it) = G(c7)e-^*'/2a+°(^) . (6.5) 
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For larger \t\, we have a rapid decay, for example by Lemma 15.101 which 
yields, for large a and \t\ > a^'^, recalling that now 7' = 7, 

\G{a + [t)\ _ \F{a + it)\ f ^ , 



\Gia)\ \Fia)\ exp^-7^(., + 0(1 + 

< exp(-cmin(|t|, |t|Vf^))- (6.6) 



for some c > 0. It follows from (j6.5p and (j6.6p that (j5.6p yields, using 
Theorem O and the choice of cr = e(i°s^-^)/'5' = e'^'/'^x^/^, 



fx{x) = ^ 1^ G(<T + it) dt ~ ^ e-^*V2. 



V27r7 -v/Svi^ 



Cl ^g(5+l/2)(logx->f)/7^-lg-70- ^ ^ ci-lg-C2xl/7^ 



The result for fy follows similarly from (|5.7p . or simpler by fviy) = 
eVx(e^). □ 

Remark 6.2. The derivative f'xi^) and higher derivatives fx\^) can be 
obtained by repeated differentiation of (j5.6p under the integral sign, which 
multiplies the integrand by a factor (— s — 1) • • • (— s — n)x~'^. The argument 
above, including the estimates (|6.5p and (j6.6p . applies to this integral as well 
and shows that, for any n > 0, 

/J)(:e) ~ a"x-"G(a)V^/72^~ a"x-"/x(x) = (c2/7)"x"(V7-i)/^(^). 

In particular, every derivative of fx tends to rapidly (faster than any 
power of x) as x — )• c«. 

Remark 6.3. The saddle-point method yields also more precise asymptotics 
including higher-orde r terms by refining the estimates around s = a in the 
proof above, see e.g. iFlajolet and Sedgewickl |l2| . Section VIII. 3]; we leave 
the details to the reader. This yields an asymptotic expansion in powers of 
cr~^, with a as in the proof above, i.e., in powers of x~^^"' . See Remark ll.lOl 
for an example of such an expansion (there obtained from a known result 
rather than by performing the calculations). 

We continue with the case p+ < 00, when F{s) has a pole at p+ of order 
uf{p+) > 1. (Recall the notion from (j4.2p .) We denote the coefficients 
of the singular part of the Laurent expansion of F at a point sq by q(so)- 

F(s) = ^ q(so)(s-so)-^ + 0(1) ass^so- (6.7) 

e=i 

In particular, ci(so) is the residue Res^o F. 



We have the following standard result by Mellin inversion, see lll |. 
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Theorem 6.4. Suppose that p-^- < oo and 7 > 0. 

(i) As X ^ CO, for some i] > 0, 

fx{x) = x-^^-^ Y: ^-^^^^f^log^'x + Oix-'^--'-^) 

e=o 

In particular, with v := uf{p+) > 1, 

fx{x) — ^ ^' 

// /9+ is a simple pole of F, i.e. v = 1, this can he written 
fx(x)^ -ReSp4F)x-P+-\ 

(ii) More precisely, there is an asymptotic expansion, for any fixed a > 0, 

o<p<(T e=o 

summing over all poles p of F in (0,0"]. (The inner sum vanishes 
unless p is a pole, so formally we may sum over all p.) 

Corresponding asymptotics for /y(y) = e^ fx{e-^) are obtained by replacing 
each x^^'~'^ by e~^y and log^x by y^. 



Proof. As said above, this is a standard result, and we refer to [Ul] for details, 
but for completeness and later use we give the simple proof. 

It suffices to prove (ii), since (i) follows by taking a = p+ + r]. We may 
assume that a is not a pole of F (otherwise we increase a a little). We start 
with (15. 6p . where we integrate over a line with Res G {p-,p+). We may, 
using Theorem 15. H shift the line to Res = a > p^ too, but then we have to 
subtract the residues of the traversed poles. Thus 

1 /"cr+ioo 

fx{x) = — x-'-^Fis)ds- ReSs=pix-'-'Fis)), (6.8) 

^1 Jcr-ioo 0<p<a 

and the result follows by computing the residues, using (j6.7p and x^^^^ = 
j.-p~i ^^q(— log x)^(s — pY/il, and noting that, by Theorem 15.11 again. 

fa+ioo /•cr+ioo 

-cr—1 / \TP^„\\A /n/"™ — o"— 1 



X 

(T— ioo 



''-^F(s)ds 



<x-''-' \F{s)\ds = 0(x-''-'). □ 



In Theorem 16. 4l fii) we have an asymptotic expansion, valid for fixed a as 
j; — )• 00. It is natural to ask whether this asymptotic expansion actually 
yields a series representation for fx{x), i.e., whether we can let cr — > 00 for 
fixed x (with the error term tending to 0) so that fx{x) is represented as a 
convergent series. This is possible sometimes, but not always. In fact, the 
following theorem shows that this is possible exactly when 7' < 0, at least 
provided that there is an infinite number of poles p > and that these are 
simple. 
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Theorem 6.5. Suppose that 7 > 0. 
(i) // 7' < 0, then, for all x > 0, 



fx{x) = Y. 



E 



log X, 



(6.9) 



summing over all poles p > of F. In particular, if F has only simple poles, 

fx{x) = ^ - 'ReSp{F)x'P-\ (6.10) 

p>0 

(ii) If y > and there is an infinite number of poles p > of F, all 
simple, then the sum (j6.10p diverges for all x > 0. 

(iii) // y = 0, then (16191) holds for x > e"" ; hence (16.10p holds for x > e'" 
provided all poles are simple. However, at least provided that there is an 
infinite number of poles p > of F and all such poles are simple, the sum 
(j6.10p diverges for < x < e^. 

Corresponding results for /y(y) are obtained by replacing x~^^^ by e~^^ 
and log^x by y^. The cut-offs in (iii) become y > >c and y < >c. 



Proof, (i) and (iii) (convergence): We use again (j6.8p . and have to show that 
the integral tends to as a —t- 00 for every fixed x > 0. We use Lemma [5. 101 
and note that < ^'(ct, t) < ^t for t > 0, and thus, because 7' < 0, for 
0- > with a e E, 

\F{a + it) 



\F{a) 



< exp(-^(7 - 7')|t| - i^\t\ + 0(1 + \t\a-^) 



exp 



vr 



-j\t\+0{l + \t\a-') 



0(e-^l*l|F(cj)|) for ah 



If o" S is large enough we thus have \F(a + it) 
real t, and hence, because 7 > 0, 

/»f7+ioo poo 

/ \x-'-^F{.s)\\ds\=0{x-''-^\F{a)\) e"^!*! dt = ©(x""" V(f^)l) • 

J a—ioo J — 00 



If 7' < 0, then this is by Theorem 15.91 o(l) as a 
which shows T 



00 for any fixed x > 0, 



If 7' = 0, then Theorem 15.91 yields, for a fixed x > 0, x " F{(t) = 
0((j^e^*'~'°^^^'^), which is o(l) for x > e^, showing the positive part of 
(iii)^ 

and (iii) (divergence): Let p > be a pole of F that is not too close to 



a zero or another pole, meaning that the distance to every zero or other pole 
is at least some small constant ^ > 0. (This is true for all poles if all a,j,a'i^ 
are commensurable and ^ is small enough; in general it is true for a large 
fraction of the poles, and certainly an infinite number of them.) A simple 
modification of the proof of of Theorem 15.91 then yields the same estimate 
as there for the residue at p: 



ReSp(F)| 



^<5g7'plogp+(x-7')p+0(l)^ 
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and thus, for every fixed x, 

Letting p — oo, we see that the terms of (I6.10p are unbounded if 7' > or 
7' = and X > logx; hence the sum diverges. □ 



Remark 6.6. To show divergence in (ii) and (iii) we assumed for simplicity 



that F has only simple poles on the positive axis; we conjecture that, more 
generally, (16. 9p diverges also without this restriction. 

To show divergence we also assumed that F has an infinite number of 
positive poles; this is, on the contrary, obviously necessary for divergence, 
since otherwise the sums (16. 9p and (I6.10p are finite. However, if F has only 
a finite number of positive poles, then the sum in (16. 9p or (I6.10p is not 
integrable, since it is ~ cx~^~^ log^x as x — )• 0, where p > is the largest 
pole of F and c ^ 0, £ = i'f{p) — 1; hence the sum cannot equal fx{x) for 
all a; > 0. Example 110.21 yields an example where the sum does not equal 
fx{x) for any x > (although the difference tends to rapidly as x — )• cxd 
by Theorem 16. 4p . 

In this connection, note that if 7 > 7', then there is an infinite number 
of poles in (0,oo) by Proposition 14.61 

We now consider x — >• and y — t- —00. We obtain the following by the 
same methods as above (now moving the line of integration towards —00), 
or more simply by applying the results above to X^^ and —Y; this replaces 
F{s) by F{—s) and the Laurent coefficients C£(so) by (— 1)^q(— sq). 

Theorem 6.7. Suppose that p„ = —00 and 7 > 0. Then 



/x(x)~C3X-^i-ie-^«^"^', x^O, 



fviy) - -g^e--(^-)-^-'^-'"^^ y ^ -00, 



where 



ci := (5 + l/2)/7, 
C3 := 76''/'^, 



C3 



Theorem 6.8. Suppose that p_ > —00 and 7 > 0. 

(i) X \ 0, for some r] > 0, 

/x(x) = xl^-l-^ Y: ^^±^log^(l/x)+0(xl^-l-^+^) 

In particular, with v := vf{p~) > 1, 

fx{x) ^ ^^^x\''-\''\og''~\l/x). 
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// p- is a simple pole of F, i.e. u = 1, this can be written 
fx{x)^ReSp_{F)x\P-\-\ 
(ii) More precisely, there is an asymptotic expansion, for any fixed a > 0, 

o>p>-o- e=o 
summing over all poles p of F in [— cr, 0) . 
Corresponding asymptotics for = e^/x(e^) are obtained by replacing 

each x^~^ by e^^ andlog^{l/x) by {—yY- 

Theorem 6.9. Suppose that 7 > 0. 

(i) // 7' > 0, then, for all x > 0, 

fx{x)=Y: E (6.11) 

p<0 l=Q 

summing over all poles p < of F. In particular, if F has only simple poles, 

= EReSp(F)xl''l-i. (6.12) 

(ii) /f 7' < and there is an infinite number of poles p < of F, all 
simple, then the sum (j6.10p diverges for all x > 0. 

(iii) // y = 0, then ([6TT]) holds for < x < e"" ; hence ([02]) holds for 
< X < provided all poles are simple. However, at least provided that 
there is an infinite number of poles p < of F and all such poles are simple, 
the sum (|6.12p diverges for x > e^. 

Corresponding results for /y(y) are obtained by replacing x^^^~^ by e''''^ 
and log^(l/x) by {—yY. The cut-offs in (iii) become y < >c and y > >c. 

Theorems 16.51 and 16.91 say that (at least if 7 > 0), fx{x) has a series 
expansion in positive (but not necessarily integer) powers of x if 7' > 0, 
and a series expansion in negative (but not necessarily integer) powers of x 
if 7' < 0, in both cases allowing for terms with logarithmic factors too; if 
7' = one expansion holds for < x < and the other for x > e^. 

Remark 6.10. Suppose that all aj,a^ are commensurable; then F{s) may 
as in Section H] (see the proof of Lemma [4. 2 [) be rewritten with all aj,a'^ = itr, 
for some real r > 0. The poles of F in (— (X),0) then form one or several 
arithmetic series {sj— n/r} with gap 1/r, possibly apart from a finite number 
of other poles. If further all poles are simple, then the residue at such a pole 
si - n/r is of the form {C /r){-DY{n\)-^\[-^iT{n + Cj)/\[^{T{n + c'J, 
and the contribution to (16.12P from this series of poles is a (generalized) 
hypergeometric series with argument —Dx^^'^, times a constant and a power 
of X. Consequently, if further 7,7' > 0, then the density function may be 
expressed using one or several hypergeometric functions. Typical examples 
are given in Theorems 11.81 and 11.131 
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As a corollary, we get results on continuity and differentiability at 0. 

Theorem 6.11. Suppose that 7 > 0. 

(i) The density fx is continuous at 0, and thus everywhere on M, if and 
only if < — 1 . 

(ii) The density fx has a finite jump at if and only if p- = —1 and this 
is a simple pole of F. In this case /x(0+) = ReSp_(F). 

(iii) The density fx is infinitely difjerentiable on M if and only if p- = 
—00. 

Proof. Note that fx is infinitely differentiable on (0, 00) by Theorem 15.41 as 

well as, trivially, on (— oo,0) where it vanishes. 

Parts (i) and (ii) follow immediately from Theorems 16.71 and 16.81 

If fx is infinitely differentiable at 0, then every derivative /j^^(O) = 

because fx vanishes on (— oo,0). Hence a Taylor expansion shows that 

fx{x) = 0{x^) as X —7- for every integer A^. If /)_ were finite, this would 

contradict Theorem 16. 8t hence p- = —00. 

Conversely, if p- = —00, then Theorem 16.71 shows that fx{x) tends to 

rapidly as x \ 0. Moreover, by Remark 16.21 and the usual change of 

variables x 1— >• the same holds for each derivative f^\x). It follows, by 

induction, that each derivative f^^\x) exists also at x = with /j^''(0) = 0. 
Hence fx is infinitely differentiable. □ 

Remark 6.12. More generally, fx has n continuous derivatives (at 0) if 
and only if p_ < — n — 1; we omit the details. 

Remark 6.13. We have in this section assumed 7 > in order to have 
good estimates of F{s) as |Ims| — )■ 00 in the proofs. It seems likely that 
the results can be extended to the case 7 = too, under suitable conditions, 
but we have not pursued this beyond noting that the results above hold also 
for the examples in Section [3] with 7 = 0. 

For example, the uniform distribution in Example 13.31 has p+ = 00, = 
— 1, 7 = 7' = 0, X = and a single, simple pole at —1; the series in (j6.10p 
is thus and the series in (|6.12p is 1, so (j6.10p holds for x > e*' = 1 and 
(|6.12p holds for x < e*' = 1. The asymptotic result in Theorem 16.11 is not 
directly applicable, since the exponent I/7 = 00, but it can be interpreted 
as /x(a^) = for large x, which is correct. 

The same holds, mutatis mutandis, for the Pareto distribution in Exam- 
ple [3T3l where now there is a single pole at a > and the density vanishes 



Similarly, for the Beta distribution B(a,/3) in Example 13.41 the series in 



on (0,1). 



(I6T2I1 is 



n=0 




00 



(-1)" r(a + /3) 
n! r(a)r(/3-n) 



X 



.n+a—l 



r(a + /3) 

r(a)r(/3) 



X' 



.a-1 
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which for x < 1 = converges to the density f{x) = (r(a + /3)/r(a)r(/3)) • 
x'^~^{l — x)^~'^; for X > 1 this series diverges unless /3 is an integer (when 
the series is finite but does not yield /(x) = for x > 1), while ()6.10p holds 
trivially. 

The r(n) distribution in Example 13.171 is an example with a multiple 
pole. There is a single pole at 1, with c„(l) = (—1)" and q(1) = 0, £ / 
n. Hence the sum in (|6.9p is, rewritten for fy as stated in Theorem 16. 5^ 
(l/(n — l)\)y"'~^e~y , which is the correct density for y > x = 0. 

We give some examples of applying the theorems above to the distribu- 
tions in Section [3l This is mainly as an illustration of the theorems; we 
cannot expect to obtain any new results for these classical distributions. 
Other applications of the theorems are given in Theorems 11.81 11-91 11-131 
[TTil [9Tl [Ql [9:6119:71 

Example 6.14. For the exponential distribution in Example 13.21 Theo- 
rem [6]T] yields /(x) ~ as X — )• oo (this is actually an identity for all x > 0) 
and Theorem 16.91 yields, since the poles are at —n — 1, with n = 0, 1, ... , 
/(^) = Z]^o(~-'-)"^"/^'' ^ > 0) again a trival result. 

Example 6.15. Similarly, for the Gumbel distribution in Example 13.181 
f{y) = e^y~^ ^ and the asymptotic formula in Theorem 16.71 is actually an 
equality for all real y. 

Example 6.16. Consider the stable distribution in Example 13.101 with < 
a < 1. Since 7 > > 7', we can apply Theorem 16. ^fi)[ By (|3.16p . F{s) := 
E has simple poles at s = na, re = 1, 2, ... , and, using ()A.6p . 

-aResi-n(r) _ i-ira 
nesna[r)- (n-l)!r(l-rea) 

_ / ^^n ar(rea)sin(7rrea) ^ r(rea + 1) sin(7rrea) 

(n — 1)! vr 7rn! 

(This includes the case when na is an integer, in which case na is not a pole 
because of cancellation; (|6.13p then correctly yields Res„Q,(F) = 0.) We thus 
obtain by ([6T0]) 

fsA-) = V(-ir+^ '^^"" + '^f"^"""^ x— ^ (6.14) 

n=l 

This is the well-known formula for the stable density, see |FMler|[i, XVII.(6.8)] 
(with 7 = —a for the positive case studied here). 

In particular, as x — )• 00, (I6.14p or Theorem 16.41 (with = a) yields 

fs^x) ~ - Res,(F)x-"'i = ^, " . x-°-\ x ^ 00. 

1 (1 — aj 

As X — )■ 0, Theorem 16.71 yields rapid convergence to 0: 

fsAx) ~ C'3X-(2-")/(2-2")e-3.-^/(-"), ^ \^ 0, (6.15) 
with C3 = (1 - a)a°/(i-°) and C3 = (27r(l - a))-i/2ai/(2-2a) _ 
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Example 6.17. Consider the Mittag-Leffler distribution in Example 13.111 
with < a < 1. Since 7,7' > 0, we can apply Theorem l6.E|n)[ By (|3.17p . 
F{s) := EM^ has simple poles at s = — n, n = 1,2,..., and, using ()A.6p . 
cf. (1613)1 . 

Resi-n(r) _ (-1)""^ 1 r(na) sin(7rnQ;) 

r(l-na) (n-l)!r(l-na) ^ ^ (n-l)!7r ' 

(Again, this includes the case when na is an integer, in which case — n is 
not a pole but the formula correctly yields 0.) We thus obtain by (|6.12p 



^-^ (n — 1)! TT 

n=l 

= ^^m r(ma + a)sin(7ra(m + 1)) ^^ 



m! TT 

m=0 



(This is also easily obtained from the stable density (16.140 since Ma = S^" 
and thus fM^ix) = ct^^x^^^"'^^ fsaix^^^°')-) In particular, in accordance 
with Theorem 16.111 

f {n>\ r(a)sin(7ra) 1 



TT r(l-a) 
As X — >• 00, Theorem 16.11 yields 

with C2 = (1 - a)Q"/(l-°) and C2 = (27r(l - Q))-V2Q(2a~l)/{2-2a) ^ (T^ig 

also follows from ()6.15p .) 

Example 6.18. The Levy area in Examp le 1 3 . 1 9 1 has the moment generating 
function (|3.35p with simple poles at (n + |)7r, n G Z. Theorem 16.51 yields, 
for ?/ > x = 0, 

l + e-'^?' 2 cosh(7r?//2) 

while Theorem 16.91 yields, for ?/ < 0, 



/(y) = J](-l)"-ie(--i)-2' 

n=l 



X^e^y ~ 2cosh(7ry/2)' 



The two sums thus sum to the same analytic expression; hence A has the 
density 1/2 cosh(7rjy /2) for —00 < y < 00. (For a more elegant proof of this, 



see e.g. 



Protter 



28|, p. 91]. 



38 



SVANTE JANSON 



7. Brownian supremum process area 

We consider the integral A = A{1) of the Brownian supremum process 
defined in (11.51). 



Remark 7.1. Let L{t) denote the local time of B{t) at 0. It is well-known 
that the processes S(t) and L(t), have the same distribution [30, Chapter 
VI.2]: 

Consequently, A{T) = L{t) dt, so we obtain the same results for this 
integral. 

Let ■0 denote the Laplace transform of A: 

V^(s) :=Ee-^^. (7.1) 

Janson and Petersson [l^ proved the following formula for the Laplace trans- 
form of a variation of if), or in other words, a double Laplace transform of 
A: For all a, A > 0, 

\A(at3/2)e-^Mt = + ^'"'e-^'dt. (7.2) 



Janson and Petersson [19] used (j7.2p to compute the integer moments 
E^", n G N; Theorem 11.61 extends their formula to all real and complex 
moments. 

Proof of Theorem \1.6[ Consider for convenience X := ^A. Taking a = 
V8/3 in dZSI), we find, for A > 0, 

" E e-*^'^^e-^* dt = l^°°{l + ^y'^\-''dt. (7.3) 

Denote the common value of the integrals in (j7.3p by G(A). 

Let — 1 < s < 0, and integrate A''G(A). From the left hand side in (|7.3p 
we obtain, using Fubini's theorem a couple of times, the standard Gamma 
integral (IA.7p . and the change of variables t^^^ = u, 

/ G(A)AMA= / / Ee-*'^'^e-^*AMtdA 
Jo Jo Jo 

= r(s + l)E / e-''^'^t-'-^dt 
Jo 

= r(s + l)E- / e-"^tx-2^/3-i 

= -r(s + l)r(-2s/3)EX2^/3. (7.4) 
3 

Similarly, from the right hand side of (j7.3p , using the changes of variables 
t = A^/^x and A = n^/^, and the standard Gamma and Beta integrals (IA.7P 
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and (fATO]) . still assuming — 1 < s < 0, 



f 

Jo 



Jo Jo 

ry poo poo 

3 Jo Jo 

= -r(2s/3 + i)/ {i + xy^/'^x-^'/^-^dx 

3 Jo 

2 , , r(-2s/3)r(2s/3 + 2/3) , , 

Setting the right hand sides of ()7.4p and (|7.5p equal, we find after some 
cancellations, 

p ^2s/3 ^ r(2s/3 + l)r(25/3 + 2/3) 

r(2/3)r(s + 1) 

for — 1 < s < 0, and thus, replacing s by 3s/2, 

EX- = IIi±ilS£±M, (7.6) 

r(2/3)r(3s/2 + l)' ^ ' 

for -2/3 < s < 0. 

We use Theorem 12.11 to extend the domain of validity of ()7.6p . Denote, 
as usual, the right hand side of ()7.6p by F(s), and note that s = —2/3 
is not a pole of F{s); it is a removable singularity since the poles in the 
numerator and denominator at —2/3 cancel. The first pole of G{s) on the 
negative real axis is s = —1. This can also be seen by the functional equation 
T{z + 1) = zT{z), which enables us to rewrite (I7.6P as 

where the right hand side clearly has a pole at —1 but not in (— 1, oo). Hence 
P- = —1 and p+ = oo, so (17. 6p and (17. 7p hold for Re s > —1 by Theorem l2.lt 
while E^** = oo for s < —1. 

Next, the triplication and duplication formulas (IA.4P and (1A.3P yield 

r(s + i)r(s + 4/3)r(s + 5/3) = 2TT3-^'-^+^/^r{3s + 3) 

^ ^i/223^+33-3s-5/2p(3^/2 + 3/2)r(3s/2 + 2), 

and thus 

r(5 + l)r(g + 5/3) _ i/2g3o-5/2 r(3V2 + 3/2) /23y 

r(3s/2 + 2) r(s + 4/3) V33; ■ 

The third formula for E follows by substituting this into ()7.7p , and using 
r(l/3)r(2/3) = 7r/sin(7r/3) = 27r/V^ from dXH]) . (The constant factor can 
always be found by setting s = 0, see Remark 11.21 ) 
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Similarly, the final formula follows by applying the duplication formula 
(fX3l) to T{s + 4/3) and the triplication formula (1X4]) to r(3s/2 + 3/2). 
(Alternatively, we may use (j7.6p . applying the duplication formula to r(s+l) 
and r(s + 2/3) and the triplication formula to r(3s/2 + 1).) □ 

We have p+ = oo and p_ = — 1 for A. Further, the parameters in (12.40 - 
(|2.8p are, from any of the expressions in Theorem 1 1.6 1 ^ = 7' = 1/2, 6 = 1/6, 
>c = -^log3, Ci = 7r-i/2r(l/3) = 20i73/r(2/3). Theorem O thus yields 

as s — )• cxD, found for integer s in [l^ . 

Proof of Theorem \1.8[ The existence of the density function fj[{x) follows 
from Theorem 15.41 The explicit formulas are obtained from Theorem 16.91 as 
follows. We use the last expression in Theorem 11.61 for F{s) := E^**, where 
there is no cancellation of poles. The poles are thus given by, for n E Z>o, 
s/2 + 1/2 = — n and s/2 + 5/6 = — n, i.e. s = —2n — 1 and s = —2n — 5/3; 
all poles are simple. The same formula yields the residues, using ([ITTT|l and 
(HD, 

p (T?^ r(l/3) (-l)"r(l/3-n) ^2^-1/2 
Res_2„_i(-F) = — 77^ 2 



2V3vr n! r(l/6-n) V3/ 

2V63i/2r(l/3) r(n + 5/6) sin(7r/6 - nvr) /3\" 
^~ n n!r(n + 2/3) " sin(7r/3 - nvr) ' 

(_l)n.2'^'W3) r(n + 5/6) ^3^" 



vr n!r(n + 2/3) 

2" 7 2i/37r n! r(-l/6-n) V3/ 

^ 3V3r(l/3) r(n + 7/6) /3x- 

^ ' 2V6vr n!r(n + 4/3) V2; ' 



Consequently, by Theorem 16.91 in particular (16.120 

V6) 
2/3) 



/^(x)- - 2^(-i) ^,r(„ + 2/3) I2J 



n=0 

, 3V3r(l/3)^, r(n + 7/6) /3x 

2n+2/3 

2V6vr ^ n!r(n + 4/3) V2; 



n=0 



By the definition of iFi, and simplifying the constants using ()A.3P and 
(IXel) . this can be written as 



^ P /5 2 _3 2\ 2-V63I/3 ^ 4 _3 2 

^1/21^1^6' 3' 2'' r(5/6) '^V6'3' 
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By Kummer's transformation [1, (13.1.27)], this equals 
_3,2 / 1 2 3 ,\ 2-V63I/3 




7ri/2 ' "V 6' 3' 2 y r(5/6) 

which can be rewritten as the two last formulas in the theorem by the 
definition of U [H, (13.1.3)], see also [1, (13.1.29)], again using (|X3l) and 
()A.6P to simplify constants. □ 

Proof of Theorem \1.9l Immediate by Theorem 16.11 □ 

Remark 7.2. The hypergeometric function 1^1(0; 5; x) and U{a; b; x) satis- 
fies Kummer's equation xF" + {b — x)F' — aF = [l, (13.1.1)], and it follows 
easily that satisfies the differential equation 

xf'J^ix) + (3x2 ^ 1 )^/^(^) ^ 5x/^(x) = 0, x>0. (7.9) 

We guess that it also is possible to derive this equation directly from (|7.2p 
by manipulations of Laplace transforms, but we have not pursued this. 

8. A HASHING VARIABLE 

As said in Section [H when study ing the maximum displacement in hashing 



with linear probing. iPeterssonI \24 . Theorem 5.1] found as a limit a random 
variable Ai with the distribution 

F{M >x) = 7p{x^/^) = E e"^'^"-^, x>0, (8.1) 

where A is the Brownian supremum area studied in Section [71 Lemma 11.111 
shows that this type of relation preserves moments of Gamma type; hence 
M. has moments of Gamma type, but we have postponed the proof until 
now. 

Proof of Lemma \l.ll{ For x > 0, 

p(^i/a/^i/a > ^) = p(2- > x'^Z) = E(P(r > I Z)) = Ee"^"^ 

which shows that (|1.10p and (|1.11|) are equivalent. 

If (|l.lUp or (|l.lip holds, and thus both hold, then, for s > —a, using 

EF*^ =Er'/"EZ-'/" = r(s/a + l)EZ""/°. □ 

Proof of Theorem \ 1.1 21 By ()8.ip and Lemma ll.lH with a = 3/2, 

EA^'* = r(2s/3 + l)E^"2'/^ 

and the result follows from Theorem II. 6| for the last formula we also use 
fOl) . □ 

Note also that Lemma 1 1 . 1 1 1 yields the representation 

M = T'/^A-^/', (8.2) 

where T"^/^ has a Weibull distribution with parameter 3/2, cf. Example 13.91 
and is independent of A. 
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For Ai, the parameters in (|2.4p - (l2.8p are, from any of the expressions in 
Theoremina 7 = 1, 7' = 1/3, 6 = 2/3, x = |log2, Ci = 2'^/^3-^/''^T{l/3) = 
2i3/63-7/6^/P(-2/3). Furthermore, the function F{s) := EA^^ (extended to 
aU of the complex plane) has residue —3/\/2tt at = 3/2, and at 
p_ = —3/2. (See the proofs below for the other residues.) 

Proof of Theorem \1.13[ As in the proof of Theorem 11.81 the existence of the 
density function fj\^ (x) follows from Theorem 15.41 and the explicit formulas 
are obtained from Theorem l6.9l We use the third expression in Theorem 11.61 
for F{s) := EA^'^. The poles p < all come from the factor r(l + 2s/3) 
and are thus given by, for n G Z>o, 1 + 2p/3 = — n, i.e. p = — 3n/2 — 3/2. 
All poles are simple and we find using (lA.lip the residues 



Res 3 3(i^) 
2" 2 



r(l/3) r(l + n/2)r(4/3 + n/2) /3\-i/2-n/2 3 (_i) 



2i/3vr r(7/6 + n/2) \2J 2 n! 

Consequently, by Theorem 16.91 in particular (j6.12p . 

_ 3V^r(l/3) ^,„ r(l + n/2)r(4/3 + n/2) f2Y/\sn/2+i/2 

JM[x)- L) r(7/6 + n/2)n! Ks) 

Splitting the sum into two parts, for n = 2k and n = 2k + 1, and using 
(2A:)! = 7r-i/222fcr(A; + l/2)A:! and (2A: + 1)! = TT-^/^2^''+^k]T{k + 3/2), both 
instances of ()A.3p . we obtain, as usual using (|A.3p and (|A.6p . 



3V^r(l/3) ^ r(4/3 + A;) /U 
■/^^ > 25/67ri/2 Z-.r(7/6 + A;)r(l/2 + A:) V6/ 



3.3^+1/2 



r(i/3) ^ r(ii/6 + fc) ^ 1 ^ fe^3,+2 



3i/2r(l/3)g r(4/3 + A;) fl^k 

k=0 

2^/^7r^/^ f^^r{5/3 + k) kl\6 

3V^r(l/3) r(4/3) 1/2 p /4 7 1 ^ 
25/6^1/2 r(7/6)r(l/2) ^ H3' '6' 2' 6 

r(i/3) r(ii/6) 2 p /II 5 x3 

-X iPi I — , — , — 



24/3^1/2 r(5/3) ' n 6 ' 3' 6 



2^/^ 1/2 ^ /4 7 1 x^x 5 /II 5 x^\ 

jX^^2F2{-,l; -,-] — ] - -x^Fi (—;-; — ). □ 



1/2 ^ ^3' ' 6' 2' 6 7 8 ' 'V 6 ' 3' 6 



Proof of Theorem \1.14\ As remarked above, the residue at p-i- = 3/2 is 
—3/^/2tt, and the next pole is at 5/2, which yields (11.14p by Theorem 16.41 

More precisely, by the last expression in Theorem 11.121 there are, on the 
positive real axis, poles when 1/2 — s/3 = —n or 5/6 — s/3 = —n for integer 
n > 0, i.e., s = 3n + 3/2 and s = 3n + 5/2. The residues are, using (lA.lip 
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and (fATH]) . 

^ n\ 2i/37r3/2 r(l/6-n) 

_ ^^i 2V63r(l/3) r(3/2 + n)r(5/6 + n) 
^ ^ 7r3/2 ■ r(2/3 + n) 
J-ir r(l/3) r(4/3 + n)r(ll/6 + n)r(-l/3-n) +5/5 
Res3.+5/2(i^) = -3 ^, 21/3,^3/2 r(-l/6-n) ^ 

^ ^ ^^,^i 2V23^/3r(l/3) _ r(ll/6 + n)r(7/6 + n) _ 

By Theorem 16. 4| there is an asymptotic expansion — X]p>o R®^p(-^)^~''~^' 
which by the definition of the (generahzed) hypergeometric series can be 
written as in (jl.lSp . yet again using (jA.lip and ()A.6p . □ 



9. Triangular and diagonal Polya urns 

A generahzed Polya urn contains balls of several different colours. At 
each time n > 1, one of the balls is drawn at random, and a set of new 
balls, depending on the colour of the drawn ball, is added to the urn. We 
consider for simplicity only the case of two colours, say black and white; the 
replacement rule may then be described by a matrix meaning that if 

the drawn ball is black [white], it is replaced together with a black and b 
white balls [c black and d white balls]. It is here natural to let a,b,c,d be 
non- negative integers, but in fact, the model can be defined (and the results 
below hold) for arbitrary real a,b,c,d > 0, see 15; [3]. (Further, under 



certain conditions some of the entries can be negative too, but that case is 
not interesting here.) Different values of the parameters yield a variety of 
different limit laws for the numbers Bn and Wn of black and white balls in 
the urn after n steps, see e.g. 0; H and the references given there. We 



are here interested in the special case of a triangular urn, meaning that the 
replacement matrix is triangular, say 6 = 0. We start with Bq = bo > 
black and Wq = wq > white balls, and assume wq > (otherwise, there 
will never be any white balls). 

9.1. Balanced triangular urns. Assume that the urn is triangular and 
balanced, meaning that the total number of added balls does not depend 
on the drawn ball, i.e., a = c + d; we further assume that a,c,d > 0; 
thus g > d > and c = a — d. In this case, it is shown by Puyhaubert [2§], 
Flajolet. Dumas and Puvhaubert (lol . Section 7] and (with a different proof) 

Janson 16 . Theorems 1.3(v) and 1.7] that Wn/n'^^"' — — -)• W for a random 



variable W with moments of Gamma type given by 

r{wo/d) T{ds/a + {bo + wo)/a)' d ^ ^ 
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In the special case {bo,wo) = (c, d), and thus Bq + wq = a, this simphfies 
to d^T{s + \)/T{ds/a + 1), so W/d has a Mittag-Leffler distribution with 
parameter d/a G (0, 1), see (|3.17p . 

An poles of F{s) := EVF'^ are on the negative real axis, so p+ = oo. 
In general, (19. ip shows that there is a pole at —wo/d, but if bo = 0, then 
this singularity is removable and the first pole on the negative real axis is 
—wo/d — 1. We thus have p_ = —wo/d when bo > 0, but p- = —wo/d — 1 
when bo = 0. In fact, if bo = 0, so we start with only wo white balls, the first 
drawn ball is necessarily white, and thus urn after the first draw contains c 
black and wo + d white balls. Thus the limit random variable W is the same 
for the initial conditions (0, wo) and (c, wo + d), and we may without loss of 
generality assume that 6o > 0. 

By (j9.ip . we have = = 1 — d/a = c/a, 6 = wo/d — {bo + 'Wo)/a, x = 
-^log^ + logd = (clogd + dloga)/a, and Ci = (a/(i)(^o+t«o)/a-i/2r((5o + 
wo)/a)/T{wo/d). 

The function F{s) in (jD.ip has simple poles at s = —wo/d—n, n = 0, 1, . . . , 
(except that some of these may in fact be removable singularities) and Theo- 
rems [53] and [GTl] yield by a straightforward calculation of the residues, using 
(jXTT]) and (jATep . the following: 

Theorem 9.1. The limit variable W for a balanced triangular urn (^|]) 
with a = c + d and a, c, d,wo > has a density function fw on (0, oo) given 
by, for X > 0, 

T{{bo + wo)/a) ^{-ir d—^^l'^ n+^o/d-i 
^ T[wo/d) n! T{-dn/a + bo/a) 



r((6o + wo)/a) (-l)" ^rdn + a-bo\ 7r(6o - dn) /x^^"+"'o/d 
iTdr{wo/d) ^ n! V a / ™ a \d 



-1 



In fact, fl(j] even gives a local limit theorem to this density function. 

Remark 9.2. It follows from Theorem 19.11 by comparison with Exam- 
ple [6?TZ1 or more simply directly from (|9.ip and (j3.17p . that in the special 
case 6o = 0, W/d has a Mittag-Leffler (d/a) distribution conjugated with 
^■wo/d^ see Remark 12.111 similarly, in the special case bo = c = a — d, W/d 
has a Mittag-Leffler(d/a) distribution conjugated with 

Theorem 19 . 1 1 shows immediately that as x \ 0, the density fw{x) satisfies 
fw{x) ~ C7'x'"o/'^-i where C = T{{bo + wo)/a){T{vuo/d)T{bo/a))-^d-'"'^/'^ > 
0, provided &o > 0. For large x. Theorem 16.11 yields : 

Theorem 9.3. As x ^ oo, 

fw(x)^C2x'^~^e-''^^^'\ 
with ci = {5 + l/2)a/c, c^ = ca-'^l'^d'^, C2 = Ci(2^c/a)-i/2(^ad/c)-(<5+i/2)^ 
where 6 and Ci are given above. 
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Remark 9.4. For non-balanced triangular urns (a 7^ c+d), limit results are 



given in [16(], but the results are more complicated and we do not believe that 



the limits have moments of Gamma type. (See for example [16', Theorem 
1.6], which gives a complicated integral formula for the moments in the case 
a > d > 0, c > 0. In the balanced case, it simplifies to ()9.ip . but as far as 
we know, there is no similar simplification in general. 

Remark 9.5. The case of triangular urns with three or more colours is not 
yet fully explored. Limit laws with moments of Gamma type occur in some 
cases, but presumably not in all. Some such results are given by Puyhaubert 
[2^, see also Flajolet, Dumas and Puyhaubert flol |. 

9.2. Diagonal urns. In the diagonal case b = c = (with a,d,bo,XQ > 
to avoid trivialities), there are simple limit results, see [li. Theorem 1.4]. 
We distinguish between three cases. 

(i) If a = d, the classical Polya urn 0; HI], Wn/n W where W/d £ 
3(100 /a, bo /a). Hence, by Example 13.41 W has moments of Gamma type 

E^- = a- '^((t°.^"°;/"^^/^^ + "°/"|, „ .>-^. (9.2) 
T[wo/a) T[s + [bo + wo)/a) a 

Hence, recalling that a = d, (|9.ip holds in this case too. We have p+ = 
00, p- = -Wo/ a, 7 = 7' = 0, = -bo/a, x = logo, Ci = r((6o + 
wo)/a)/T{wo/a). 

(ii) If a > d, Wn/n'^/'' W := dU-'^^'^V where U G r{bo/a) and V G 
T{wo/d) are independent. Thus, by (j3.ip . 



1^ TT.s ,s T{bo/a- ds/a)T{wo/d + s) ^0 ^ -p ^ bo , . 
Tibo/a)T{wo/d) ' -T<^^^<7- 

We have p+ = bo/d, = —wo/d, 7 = 1 + d/a, 7' = 1 — d/a, 6 = bo/a + 
wo/d-l, X = -^log^ + logd, Ci = 27:{T{bo/a)nwo/d))-\d/af°'^-^'\ 
Theorems 15.41 and 16.91 apply again and yield the following: 

Theorem 9.6. The limit variable W for a diagonal urn ( g ^) with a > d > 
and bo, Wo > has a density function fw on (0,oo) given by, for x > 0, 

r I ^ (-1)" / dn + fep + wo \ /xx«+^o/rf-i 

■'^^''^ ~ dr{bo/a)r{wo/d) n! V a )\d) 

Again, the asymptotic fwi^) ~ c'x'^'^/'^~^ as x \ 0, for some C > 0, is 
immediate. For large x, we this time use Theorem [631 since /)+ < 00. The 
poles of (19. Sp on the positive real axis are (an + bo)/d, n = 0,1, . . . , and the 
residues are easily calculated. This yields a divergent asymptotic expansion, 
interpreted as in Remark 11.101 

Theorem 9.7. As x ^ 00, the density fwi^) has an asymptotic expansion 

, . a ^ /an + bo + wo\^x\-an/d-bo/d-i 

^^^^^ " d2r(6o/a)r(u;o/d) ^ V d / \d 
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(iii) If a < d, we may interchange the two colours and obtain n "'^'^{nd — 

Wn) W := dUV-''/'^, with U and V as above, and aW/d has the 
distribution in (ii) with the exchanges a -H- d and 60 ^ wq. 

10. Further examples 

We give a couple of further examples, or rather counter examples. 

Example 10.1. Let X have a distribution that is a mixture of a point 
mass at 1 and a uniform distribution on [0,1], with equal weights; thus 
X = 1 -V + VU where V G Be(l/2) and U G U(0, 1) are independent. 
Then, for Res > —1, 



2 2 2 2 s + l 2(s + l) 2r(s + 2)2 

(10.1) 

Equivalently, 

s + l r(s/2 + l)r(s + 2) ^ ^ 

Hence X has moments of Gamma type. We have = 00, p_ = —1, 
7 = y = 5 = X = and Ci = 1/2. Note that EX'* ^ 1/2 / as t ^ ±00; 
cf. Remark! 



Example 10.2. Consider X := T/U, where T ~ Exp(l) and U ~ U(0, 1) 
are independent. Then, see Remark 11.51 and Examples 13.21 and 13. 3| X has 
moments of Gamma type 

EX. = ni±i)=ni±Wl^, -l<Re.<l. (10.3) 

1 — s L [2 — sj 

Consequently, /?+ = 1 and p- = —1. There is an infinite number of poles 
on the negative real axis, viz. —1, —2, . . . , but the only pole on the positive 
real axis is 1. We have 7 = 7' = 1, 5 = — 1/2, x = 0, Ci = \/2tt. 
It is easy to find the density oi X = T/U: for x > 0, 



¥{T/U >x)= P(T >Ux)= f P(T > ux) du = [ 

Jo Jo 



and thus X has the density function 

1 - (1 + x)e~ 
dx x x"^ 
Since 7, 7' > 0, Theorem l6.9l applies. The residue at — n— 1 is (—1)"/ (n! (n+ 
2) and (fCnj) yields 

^^^^ " ^ (n + 2)n!''" 

n=0 

which, of course, also follows directly from (110. 4p . 

However, in Theorem 16.51 although the sum in (j6.10p consists of a single 
term and thus converges, the sum / f{x) for all x > 0, as asserted 
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in Remark 16.61 (But the error is exponentially small, and the estimates in 
Theorem 16.41 apply.) 

11. Further remarks 

Remark 11.1. Suppose that X is a positive random variable with finite 
moments (of all positive orders): EX" < oo for n > 0. If X has moments 
of Gamma type, then p+ = oo and (jl.ip gives, in particular, a formula 
for all integer moments KX"' in terms of Gamma functions. However, the 
converse does not hold; even if (jl.lh holds for every integer s > 0, it does not 
necessarily hold for other s. An example is provided by Stieltjes' original 
example of indeterminacy in the moment problem [33 . §55]: Let, for A G 
[— 1, 1], Xx have the density function a(l + A sin(3;-^/^)) exp(— x^/^) with the 
normalizing constant a = 1/24. Then, using sin(y) = (e^^ — e~'^)/2i and 

mi), 

/•oo 

EX^ = a (1 + A sin(xi/^)) e"^'^" dx 

Jo 

/■oo 1 

= 4a / ?/^"+3(l + Asin(y))e^2^dy = -r(4n + 4), 
Jo 6 

for any integer n > and any A G [—1, 1]; thus the variables X\ have the 
same integer moments. For A = 0, the same calculation applies to non- 
integer n as well, and shows that IE^q ~ ^^(^^ + 4), — l<s<oo, so Xq 
has moments of Gamma type. However, this formula cannot hold for any 
other A (and s in an interval), by the uniqueness Corollary 12.31 

Note that Xq = Z'^, where Z has the Gamma distribution r(4), cf. Exam- 
ple [3?T1 A similar example is provided by (or lA'^l" for any real number 

a > 4) with N G N(0, 1), see 0; indeed |A^|° = 2'^/^Z'^/^ with Z G r(l/2), 
see Examples 13.51 and 13. 6^ and cZ^ with c > and Z G r(7) is not de- 
termined by its (integer) moments for any 7 > and /? > 2, see e.g. (l3 . 
Section 4.10], so it too provides a counter example. See also [311 ]. 

Remark 11.2. Many of the examples in Section [3] are infinitely divisible, 
for example the Gamma distribution T{a), @, p. 26], Pa and thus Pa 
[1, p. 26], La 25]. We do not know whether there are any interesting 



connections between moments of Gamma type and infinite divisibility. 

Remark 11.3. It is possible to consider, more generally, moments of the 
form (|l.ip where aj,bj,a'j^,b'i^ may be complex (and appearing in conjugate 
pairs to make the function real for real s). We have not pursued this exten- 
sion and do not know whether there are any interesting results or examples 
for this class. A trivial example is the following. 

Let X have a two-point distribution with ¥{X = xi) = ¥(X = X2) = 1/2, 
where < xi < X2 < 00. Then Y := logX too has a two-point distribution 
with P(y = yi) = P(y = ya) = 1/2 where yj = logxj, j = 1,2. Let 
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d := E Y = {yi + y2)/2 and (3 := (?/2 - yi)/2vr; thus 2/1,2/2 = d ± vr/3. Then, 
using ()A.6p . 

EX" = Ee'^ = e"'^ cosh(7r/3s) = e"*^ sinf J+7r/3si^ - 



2 ^ 7 r(i + i/3s)r(i-i/3s)' 

Appendix A. Some standard formulas 

For the readers' (and our own) convenience we here collect some well- 
known formulas for the Gamma function, see e.g. P, Chapter 6]. Recall 
that r is a meromorphic function in the complex plane, with simple poles 
at the non-negative integers 0, —1, —2, . . . and no zeros, so l/F is an entire 
function. 

/■oo 

r(s)=/ f-^e-^dt, Res>0; (A.l) 
Jo 

r{z + 1) = zTiz); (A.2) 
T{2z) = 7r-i/222^-ir(z)r(z + i); (A.3) 
r(3z) = {27T)-^3^''^/^T{z)Tiz + i)r(z + |); (A.4) 

m— 1 

T{mz) = (27r)-('™-i)/2m"^-i/2 J| r{z + i) (A.5) 

j=0 

r(z)r(l-z) = -^; (A.6) 

/•oo 

/ t'-^e~"*dt = o"'r(s), Res>0, Rea>0; (A.7) 
Jo 

^s-i(^_^)n-i^^^ £(f)£M^ Res, Ren >0; (A.8) 
r(s + n) 

/'°°t"-i(l + t)-Mt = Ret;>Res>0; (A.9) 
Jo 

Equation ()A.7p yields by Fubini-Tonelli a relation between the Laplace 

transform and negative moments for any positive random variable X: 

/ f~^Ee-^^dt = K f-^e-^^ dt = T{s)EX-', s > 0. (A.IO) 
70 Jo 

The residue Res_n(r) = (— (an easy consequence of (IA.2P ). Thus, 
more generally, for any complex a 7^ and 6, 

Res,=_(„+b)/,(r(az + b)) = a"'^^- (A.ll) 

Stirling's formula says that for all complex z in a sector | arg z\ < n — e 
avoiding the negative real axis 

logr(z) = {z - ^)logz - z + logV2^ + 0{\z\-^), (A.12) 
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where the logarithm logz is the principal value with imaginary part in 
(— vr, vr). (Here, e > is arbitrary, but the implicit constant in the O term 
depends on e.) By differentiating (1A.12[) twice we find, for | argzj < vr — e 
(e.g., for Rez > 0), 

^(logr(z)) =logz + 0(|z|-i), (A.13) 

^(logr(z)) = i + 0(|zr^). (A.14) 

(Note that also the error term may be differentiated since the functions 
are analytic in a larger sector and we may use Cauchy's estimate for the 
derivative.) 
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